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Preface 


Lengthy  or  delayed  acquisitions  may  translate  into  a  critical  delay  of 
necessary  capabilities  to  the  warfighter  and  additional  costs  to  the  gov¬ 
ernment.  While  there  has  been  extensive  research  into  weapon  systems 
cost  growth,  the  research  to  objectively  determine  the  primary  causes 
of  longer  cycle  time  and  schedule  growth  is  less  comprehensive.  Sched¬ 
ule  management  is  challenging  because  schedule  is  intrinsically  tied  to 
many  other  aspects  of  acquisition. 

Although  large  numbers  of  studies  have  focused  on  or  provided 
insights  into  schedule-related  issues,  these  issues  are  less  well  under¬ 
stood  than  other  aspects  of  acquisition.  This  report  summarizes  the 
assertions  and  conclusions  from  such  sources.  We  do  not  analyze  these 
assertions  and  conclusions;  rather,  we  provide  an  accounting  and  sum¬ 
mary  of  the  range  of  claims  in  the  literature  at  various  periods.  More¬ 
over,  while  current  conditions  may  differ  from  history,  this  report  and 
the  sources  described  herein  provide  a  starting  point  for  examining  the 
schedule-related  aspects  of  acquisition. 

This  report  should  be  of  interest  to  government  acquisition  pro¬ 
fessionals,  oversight  organizations,  and,  especially,  the  analytic  com¬ 
munity  as  a  starting  point  for  further  research  and  analysis. 

This  research  was  sponsored  by  the  Director,  Acquisition  Resources 
and  Analysis,  in  the  Office  of  the  Under  Secretary  of  Defense  for 
Acquisition,  Technology,  and  Logistics,  U.S.  Department  of  Defense. 
This  research  was  conducted  within  the  Acquisition  and  Technology 
Policy  Center  of  the  RAND  National  Defense  Research  Institute,  a 
federally  funded  research  and  development  center  sponsored  by  the 
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Office  of  the  Secretary  of  Defense,  the  Joint  Staff,  the  Unified  Com¬ 
batant  Commands,  the  Navy,  the  Marine  Corps,  the  defense  agencies, 
and  the  defense  Intelligence  Community.  For  more  information  on  the 
Acquisition  and  Technology  Policy  Center,  see  http://www.rand.org/ 
nsrd/ndri/centers/atp.html  or  contact  the  director  (contact  information 
is  provided  on  the  web  page). 
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Summary 


This  report  summarizes  a  selection  of  the  acquisition  literature  from 
the  1960s  to  the  present  on  potential  sources  of  program  schedule  cycle 
time  and  growth,  as  well  as  potential  opportunities  for  improvement. 
It  presents  the  range  of  possible  causes  of  schedule-related  problems 
and  various  recommendations  cited  for  improving  schedules  by  various 
authors  and  organizations.  This  report  does  not  provide  critical  analysis 
or  an  assessment  of  the  strengths  or  weaknesses  of  the  claims  made  in 
the  literature.  Rather,  it  provides  a  starting  point  for  further  research  or 
consideration  by  government  acquisition  professionals,  oversight  orga¬ 
nizations,  and  the  analytic  community. 


Potential  Reasons  for  Longer  Cycle  Times  or  Schedule 
Delays 

In  documentation  accompanying  the  release  of  the  Better  Buying 
Power  2.0  program,  Frank  Kendall,  Under  Secretary  of  Defense  for 
Acquisition,  Technology,  and  Logistics,  stressed  the  need  to  “reduce 
cycle  times  while  ensuring  sound  investment  decisions.”  He  added 
that,  on  average,  programs  are  taking  about  one  year  longer  to  com¬ 
plete  their  development  contracts  than  they  did  before  1980;  the  root 
causes  of  longer  program  cycle  times  are  not  obvious,  and  the  data 
include  wide  variations  (Kendall,  2013;  OUSD[AT&L],  2013).  In 
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defense  acquisition,  cycle  time  is  often  defined  as  program  initiation1 
to  initial  operating  capability  (IOC),  though  it  can  also  be  defined  in 
other  ways,  depending  on  the  specific  focuses  of  analyses  of  acquisition 
program  life  cycles  (e.g.,  time  from  Milestone  A  to  Milestone  B  or  time 
from  Milestone  B  to  Milestone  C).  Like  the  cycle  times  of  acquisition 
programs,  schedule  growth — the  extension  to  the  planned  schedule — 
can  also  be  measured. 

One  of  the  goals  in  managing  an  acquisition  program  is  to  create 
a  realistic  schedule  based  on  technological  maturity,  system  complex¬ 
ity,  and  anticipated  budget.  We  identified  the  following  reasons  for 
schedule  delays  in  the  literature: 

•  The  reason  asserted  most  often  is  the  difficulty  of  managing 
technical  risk  (e.g.,  program  complexity,  immature  technology, 
and  unanticipated  technical  issues). 

•  The  second  most  common  reason  is  initial  assumptions  or 
expectations  that  were  difficult  to  fulfill  (e.g.,  schedule  esti¬ 
mates,  risk  control,  requirements,  and  performance  assumptions). 

•  Another  common  assertion  is  that  funding  instability  compli¬ 
cates  management  and  can  directly  stretch  production  schedules. 

Table  S.l  presents  the  full  list  of  general  causal  categories  cited 
in  the  literature  that  can  affect  longer  cycle  times  and  schedule  delays, 
along  with  attendant  detailed  characterizations  as  presented  by  various 
studies.2  Some  of  these  processes  and  activities  occur  outside  of  the 
control  of  program  management,  while  others  fall  under  the  control  of 
program  management.  Note  that  the  listed  reasons  are  not  necessarily 
internally  consistent  (i.e.,  some  studies  assert  that  some  of  these  pos¬ 
sibilities  are  not  major  concerns). 


1  Formal  program  initiation  is  normally  at  Milestone  B,  but  some  may  consider  earlier  pro¬ 
gram  initiation  points,  such  as  Milestone  A  or  even  the  prior  Materiel  Development  Decision 
(MDD). 

2  Note  that  some  of  these  may  appear  to  be  similar  or  overlapping.  We  sought  to  preserve 
the  focus  and  characterization  of  the  original  studies  in  formulating  this  table. 
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Table  S.1 

Reasons  Cited  in  the  Literature  for  Prolonged  Schedules  and  Schedule 
Slippage 


Area 

Possible  Reason 

Requirements 
development, 
generation,  and 
management 

Infeasible  or  unrealistic  requirements 

Unstable  requirements  (e.g.,  engineering  requirements, 
readiness  requirements,  reliability  and  support  requirements) 

Inefficiencies  in  the  process  (e.g.,  serial  nature  of  process  and 
requirements  evolution) 

Managing  technical 
risk 

Excessive  technical,  manufacturing,  or  integration  risk  (general) 
or  program  complexity 

Unanticipated  design,  engineering,  manufacturing,  technical 
difficulty,  or  technology  integration  issues 

Overly  optimistic  assumptions/expectations  (technical  risks, 
performance  goals,  system  requirements,  or  design  maturity) 

Immature  technology 

Concurrency  in  complicated  programs 

Prototyping 

Deficient  test  planning  or  testing  inefficiencies 

Inadequate  funds  for  testing 

Resource  allocation 

Funding  instability  or  budget  cuts 

Defense  acquisition 
management 

Lack  of  focus  on  schedule  or  inadequate  schedule  management 
(e.g.,  underutilization  of  integrated  master  schedule) 

Overly  optimistic  assumptions/expectations  in  general, 
including  insufficient  contingency  funds  in  program  budgets 

Overly  optimistic  assumptions/expectations  in  cost  and 
schedule  estimates 

Personnel  issues 

Competition 

Use  of  undefinitized  contract  actions 

Contractor  performance  and  inadequate  incentives 

Inadequate  tailoring  of  the  acquisition  process 

Other 

Delays  in  obtaining  necessary  data 
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Potential  Ways  to  Remedy  Schedule  Challenges 

Improving  a  schedule  is  about  meeting  the  mission  and  threat  in  a 
more  timely  fashion.  In  the  case  of  a  low-risk  program  employing  com¬ 
mercially  available  technologies,  schedule  improvement  may  mean  a 
tailored  reporting  and  oversight  process  that  allows  a  program  to  waive 
some  portions  of  the  acquisition  process  that  may  be  more  appropriate 
for  a  new-build,  higher-risk  program.  In  the  case  of  a  high-risk  program 
requiring  the  development  and  integration  of  new  technologies,  sched¬ 
ule  improvement  may  mean  better  risk  management  and  more  com¬ 
promises.  These  insights  may  lead  to  decisions  to  reduce  the  program 
scope,  or  even  to  cancel  the  program,  to  free  up  resources  for  more  exe¬ 
cutable  programs.  All  of  these  decisions  are  essentially  about  reducing 
and  managing  risk.  Because  of  heightened  interest  in  reducing  cycle 
times,  this  report  summarizes  published  recommendations  for  shorten¬ 
ing  timelines  (ideally  without  adverse  consequences).  In  the  literature, 
the  most  commonly  cited  recommendations  for  reducing  cycle  time 
and  controlling  schedule  growth  are  strategies  that  manage  or  reduce 
technical  risk.  Some  of  those  recommendations  include 

•  using  incremental  fielding  or  evolutionary  acquisition  (EA)  strat¬ 
egies 

•  developing  derivative  products  (rather  than  brand-new  designs) 

•  using  mature  or  proven  technology  (i.e.,  commercial,  off-the-shelf 
components). 

Other  recommendations  include  maintaining  stable  funding  and 
using  atypical  contracting  vehicles.  No  strategy  is  appropriate  in  every 
case,  so  careful  judgment  and  balancing  are  required.  Table  S.2  sum¬ 
marizes  the  strategies  suggested  in  the  literature. 
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Table  S.2 

Possible  Ways  to  Improve  Schedules  in  the  Acquisition  Literature 


Area 

Possible  Ways  to  Improve  Schedules 

Requirements 
development, 
generation,  and 
management 

Stable  and  realistic  initial  requirements,  especially  at  the 
engineering  level 

Better  collaboration  between  the  program  management 
and  end-user  communities  (with  proper  management) 

Proper  management  of  flexible  requirements 

Managing  technical 
risk  in  development 
and  production 

Use  of  mature/demonstrated  technology  to  ensure  a  high 
level  of  maturity  before  production 

Use  of  incremental  fielding  or  EA  strategies  and  the 
development  of  derivative  products  (rather  than  brand-new 
designs) 

Employment  of  "agile"  methods  that  can  easily  adapt  to 
changes  in  software  development 

Prototyping 

Concurrency  in  programs  with  low  technical  risk 

Use  of  commercially  derived  items 

Use  of  the  commercial  practice  of  freezing  the  design 
before  the  production  contract  award 

Use  of  the  commercial  practice  of  reducing  the  design's 
complexity 

Resource  allocation 

Stable  funding 

Adequate  test  funds  (hardware,  modeling  and  simulation) 

Acquisition 

management:  internal 
to  the  program 

Bypassing  competition  during  production  (including 
employing  multiyear  or  sole-source  procurement  strategies 
in  the  production  phase) 

Preplanned  product  improvement 

Acquisition  of  the  same  number  of  units  but  in  larger,  more 
economical  quantities  in  the  production  phase 

Emphasis  and  adherence  to  schedule  as  a  program  priority 

Development  and  maintenance  of  a  comprehensive  and 
realistic  master  schedule 
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Table  S.2 — continued 


Area 

Possible  Ways  to  Improve  Schedules 

Acquisition 

management:  internal 
to  the  program 
(continued) 

Use  of  contracting  vehicles  to  expedite  contracting  process 
(e.g.,  existing  contracts,  undefinitized  contracts  in  low-rate 
initial  production,  sole-source  contracts) 

Operational  testing  and  evaluation  results  available  before 
production  startup 

Use  of  modeling  and  simulation  to  reduce  the  risk  and 
duration  of  live  tests 

Involvement  of  the  test  community  in  all  program  phases 

Use  of  integrated  product  teams 

Improved  program  stability  in  general,  including  funding 
and  requirements 

Realistic  schedule  estimates 

Acquisition 

management:  external 
to  the  program 

Senior  leadership  support 

Program  identified  as  a  priority 
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CHAPTER  ONE 


Background  and  Motivation 


Lengthy  acquisitions  or  unexpected  schedule  slips  in  military  system 
acquisition  may  translate  to  a  delay  in  delivering  capabilities  to  the 
warfighter  or  additional  unexpected  costs  to  the  government.  The  U.S. 
Department  of  Defense’s  (DoD’s)  recent  Better  Buying  Power  (BBP) 
initiative  is  aimed  at  “obtaining  greater  efficiency  and  productivity  in 
defense  spending”  (Carter,  2010a,  p.  1),  including  a  focus  on  short¬ 
ening  program  cycle  times  as  part  of  its  guidance  for  improving  the 
acquisition  process: 

•  BBP  1.0:  “Set  shorter  program  timelines  and  manage  to  them,” 
stated  then-Under  Secretary  of  Defense  for  Acquisition,  Technol¬ 
ogy,  and  Logistics  (USD[AT&L])  Ashton  Carter  (Carter,  2010a, 
pp.  4-5). 

•  BBP  2.0,  introduction  to  the  acquisition  workforce:  “Reduc¬ 
ing  cycle  times  while  ensuring  sound  investment  decisions”  is  the 
initiative’s  goal,  according  to  USD(AT&L)  Frank  Kendall  (Ken¬ 
dall,  2012a,  p.  2). 

Kendall  has  further  honed  in  on  schedule  cycle  time  or  lengthy 
acquisitions,  recently  worrying  that  it  is  “taking  much  too  long”  to 
field  systems  (Parrish,  2012).  In  the  BBP  2.0  implementation  directive, 
released  April  24,  2013,  Kendall  states, 

At  this  time,  the  data  is  not  clear  as  to  the  effect  of  the  acquisition 
process  itself  on  cycle  time.  Most  decision  support  activities  over¬ 
lap  with  program  progress,  so  in  general  the  decision  making  pro- 
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cesses  add  overhead  more  than  direct  schedule  slips.  Nevertheless, 
reducing  the  burden  of  this  overhead  is  a  worthwhile  goal  in  its 
own  right.  On  average  programs  are  taking  about  1  year  longer 
to  complete  development  than  they  did  20  years  ago,  but  the  root 
causes  of  longer  program  cycle  times  are  not  obvious  and  the  data 
includes  wide  variations.  Time  is  money,  and  slowness  in  acquir¬ 
ing  major  systems  does  mean  greater  expense  and  fewer  capabili¬ 
ties  in  the  field.  There  have  been  attempts  to  use  arbitrary  cycle 
times  to  constrain  programs;  however,  these  constraints  have 
often  been  unrealistic  and  done  more  harm  than  good  by  lead¬ 
ing  to  high  risk  schedules  and  acquisition  approaches.  During 
2013,  we  will  conduct  additional  analysis  of  the  time  it  takes  from 
conception  to  introduce  a  product  to  the  field.  Under  BBP  2.0, 
we  will  focus  on  reducing  the  decision  making  cycle  time  and 
overhead  costs  while  those  studies  are  being  conducted.  (Kendall, 

2013,  p.  16) 

Kendall’s  statement  regarding  increased  cycle  times  is  supported 
by  the  annual  report  Performance  of  the  Defense  Acquisition  System, 
released  by  his  office  in  June  2013  (OUSD[AT&L],  2013).  That  analy¬ 
sis  of  a  set  of  contract  schedule  and  cost  growth  data  from  1970  to  2011 
concluded  the  following: 

•  All  other  things  equal,  development  cycle  time  on  contracts 
after  1980  took  an  average  of  0.9  years  longer  than  contracts 
before  1980 — an  increase  of  about  one-sixth  over  the  base 
of  5.2  years. 

•  Every  10-percentage-point  increase  in  work-content  cost 
growth  generally  added  0.066  years,  and  every  10-percent- 
age-point  increase  in  cost-over-target  generally  added  0.16 
years. 

•  Also,  contracts  with  undefinitized  contract  actions  (UCAs) 
were  about  0.3  years  longer  generally. 

•  Contracts  for  space  systems  were  an  additional  1.7  years 
longer,  whereas  contracts  for  aircraft  were  2.5  years  longer. 

No  other  commodity  types  had  significantly  longer  cycle 
times. 
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•  All  development  contract  cycle  times  increased  significantly 
after  1980.  (OUSD[AT&L],  2013,  pp.  55,  58) 

Literature  Review  Goals,  Methodology,  and  Limitations 

Cycle  times  and  schedule  growth — along  with  cost  growth — have 
always  been  concerns  for  DoD  acquisition  programs;  however,  the 
literature  has  historically  focused  more  directly  on  cost  growth.  We 
conducted  this  literature  review  to  capture  available  insights  on  the 
experiences  of  a  variety  of  programs  and  experts  to  illuminate  sched¬ 
ule  issues  and  potential  solutions.  The  intent  of  this  report  is  to  sum¬ 
marize  the  acquisition  literature  describing  sources  of  excessive  cycle 
time  and  schedule  growth,  as  well  as  opportunities  for  reducing  the 
time  it  takes  to  deliver  systems  from  the  perspective  of  shortening  indi¬ 
vidual  program  schedules.  This  report  does  not  provide  critical  analysis 
of  the  assertions  of  the  various  organizations  and  authors.  Rather,  it  is 
intended  to  serve  as  a  starting  point  for  further  research  or  consider¬ 
ation  by  government  acquisition  professionals,  oversight  organizations, 
and  the  analytic  community. 

Our  methodology  included  a  broad  search  of  government,  aca¬ 
demic,  and  nonprofit  analytic  sources  as  far  back  as  the  1960s.1  We  also 
consulted  subject-matter  experts  at  RAND  to  help  focus  the  review. 
We  looked  for  instances  in  which  authors  or  organizations  provided 
reasons  for  schedule  growth  or  increased  cycle  times.  We  also  searched 
for  recommendations  for  remedying  these  problems.  Finally,  we  sorted 
and  presented  the  reasons  and  recommendations  by  topic  and  source. 
(The  reasons  and  recommendations  most  commonly  addressed  in  the 
literature  are  discussed  in  greater  detail  in  Chapters  Two  and  Three.) 
This  report  identifies  factors  both  internal  and  external  to  programs 
that  influence  schedule  plans  and  schedule  outcomes. 


1  Future  research  should  include  information  on  this  topic  from  congressional  testimony 
and  Selected  Acquisition  Reports,  which  we  did  not  examine  because  of  time  constraints. 
Both  of  these  sources,  and  possibly  some  additional  sources  in  the  academic  and  policy  lit¬ 
erature,  would  strengthen  the  results  of  this  literature  review. 
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The  Importance  of  Schedule 

According  to  the  Defense  Acquisition  University’s  (DAU’s)  Scheduling 
Guide  for  Program  Managers  (2001,  p.  1),  a  schedule,  “in  its  simplest 
form  ...  is  a  listing  of  activities  and  events  organized  by  time.”  But,  in 
its  more  complex  form,  a  schedule  is  defined  as  follows: 

[T]he  process  examines  all  program  activities  and  their  relation¬ 
ships  to  each  other  in  terms  of  realistic  constraints  of  time,  funds, 
and  people,  i.e.,  resources.  In  program  management  practice,  the 
schedule  is  a  powerful  planning,  control,  and  communications 
tool  that,  when  properly  executed,  supports  time  and  cost  esti¬ 
mates,  opens  communications  among  personnel  involved  in  pro¬ 
gram  activities,  and  establishes  a  commitment  to  program  activi¬ 
ties.  (DAU,  2001,  p.  1) 

When  looking  at  changes  in  acquisition  schedules,  cycle  times  of 
programs  should  be  considered  alongside  schedule  growth.  Cycle  time 
can  be  defined  by  how  long  it  takes  a  program  to  get  from  one  part  of 
the  defense  acquisition  process  to  another.  This  could  be  from  program 
initiation2  to  initial  operating  capability  (IOC),  “Milestone  A  to  Mile¬ 
stone  B,”  or  other  periods  (e.g.,  Milestone  B  to  Milestone  C). 

In  addition,  the  Office  of  the  Under  Secretary  of  Defense  for 
Acquisition,  Technology,  and  Logistics  (OUSD[AT&L])  stresses  that 
acquisition  is  also  about  managing  risk  and  uncertainty: 

Acquisition  is  about  risk  management — not  certainties.  Espe¬ 
cially  for  major  weapons  systems  acquisitions  (which  almost 
always  involve  research  and  development),  uncertainties  imply 
cost,  schedule,  and  performance  risks  relative  to  early  estimates. 

These  risks  diminish  as  we  move  from  research  to  development 
through  production  to  sustainment,  but  their  realization  may 
result  in  cost  and  schedule  growth.  These  risks  also  require  use 
of  different  management  tools  (such  as  the  right  contract  types 


2  Formal  program  initiation  is  normally  at  Milestone  B,  but  some  may  consider  earlier  pro¬ 
gram  initiation  points  such  as  Milestone  A  or  even  the  prior  Materiel  Development  Decision 
(MDD). 
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and  incentives)  at  different  stages  to  mitigate  risks  and  motivate 
industry  to  achieve  the  lowest  possible  total  price  to  the  govern¬ 
ment.  We  must  monitor  and  explain  risks,  but  it  is  important  to 
remember  that  developing  technologically  superior  military  capa¬ 
bility  is  not  a  risk-free  endeavor.  (OUSD[AT&L],  2013,  p.  109) 


What  Lengthens  Acquisition  Schedules? 

The  most  pressing  concerns  related  to  poor  schedule  outcomes  seem 
rooted  in  two  areas:  maintaining  a  technological  edge  and  excessive 
costs.  In  a  letter  preceding  the  2012  Strategic  Guidance  for  21st  Cen¬ 
tury  Defense  (DoD,  2012a),  then-Secretary  of  Defense  Leon  Panetta 
described  tomorrow’s  military  as  “a  Joint  Force  for  the  future  that  will 
be  smaller  and  leaner,  but  will  be  agile,  flexible,  ready,  and  techno¬ 
logically  advanced.  It  will  have  cutting  edge  capabilities,  exploiting  our 
technological,  joint,  and  networked  advantage.”  Fulfilling  this  vision 
requires  the  acquisition  process  to  support  the  timely  delivery  of  sys¬ 
tems  and  capabilities.  Longer  development,  production,  and  fielding 
times  increase  the  risk  that  the  technology  may  not  be  adequate  to 
address  current  threats  or  may  become  obsolete  in  the  face  of  emerging 
threats  shortly  after  deployment.  On  the  other  hand,  artificially  accel¬ 
erated  programs  risk  schedule  and  cost  growth  as  reality  sets  in  or  with 
the  deployment  of  immature  technologies  or  flawed  weapon  systems. 
This  may,  in  turn,  result  in  the  delivery  of  reduced  capabilities  and  an 
increased  need  for  modifications  and  maintenance  in  the  future,  both 
of  which  incur  costs  and  limit  the  availability  of  new  systems.  Finally, 
the  delayed  development,  production,  and  fielding  of  new  systems  can 
ultimately  result  in  smaller  or  older  fleets,  which  may  be  inadequate  to 
face  adversaries  (see  DoD,  2012a). 

In  the  current  fiscal  environment,  the  importance  of  control¬ 
ling  costs  is  self-evident.  In  2010,  Ashton  Carter,  then  USD(AT&L), 
described  the  relationship  between  cost  and  schedule  across  program 
portfolios  in  his  BBP  1.0  guidance  to  DoD  acquisition  professionals 
using  common  perceptions  that  have  been  since  supported  by  signifi¬ 
cantly  more  data  and  analysis  (also  see  OUSD[AT&L],  2013): 
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The  leisurely  10-15  year  schedule  of  even  the  simplest  and  least 
ambitious  Department  programs  not  only  delays  the  delivery  of 
needed  capability  to  the  warfighter,  but  directly  affects  program 
cost.  As  all  programs  compete  for  funding,  the  usual  result  is 
that  a  program  settles  into  a  level-of-effort  times  the  length  of  the 
program.  Thus  a  one-year  extension  of  a  program  set  to  complete 
in  10  years  can  be  expected  to  result  in  10  percent  growth  in  cost 
as  the  team  working  on  the  project  is  kept  on  another  year.  Yet 
managers  who  run  into  a  problem  in  program  execution  generally 
cannot  easily  compromise  requirements  and  face  an  uphill  battle 
to  obtain  more  than  their  budgeted  level  of  funding.  The  frequent 
result  is  a  stretch  in  the  schedule.  (Carter,  2010a,  pp.  4-5) 

Relationships  between  cost  and  schedule  have  also  been  widely 
discussed  in  the  literature.  For  example,  numerous  studies  have 
reported  that  programs  with  longer  durations  tend  to  have  greater  cost 
growth,  possibly  because  longer  programs  are  exposed  to  more  oppor¬ 
tunities  for  changing  requirements  and  other  time-related  costs  (see, 
for  example,  Arena,  Leonard,  et  ah,  2006;  Drezner  et  ah,  1993;  Arena, 
Younossi,  et  ah,  2006;  OUSD[AT&L],  2013;  and  Drezner  and  Smith, 
1990). 3  Flowever,  this  relationship  between  cost  and  schedule  is  not  as 
simple  as  it  may  appear.  Schedule  slippage  and  cost  growth  are  often 
thought  to  go  hand  in  hand.  OUSD(AT&L)  recently  examined  some 
of  the  complexities  in  the  requirements,  technology,  cost,  and  schedule 
growth  relationship: 

Contextually,  we  note  that  the  time  required  to  acquire  next-gen¬ 
eration  capabilities  is  often  longer  than  the  strategic  threat  and 
technology  cycles  these  capabilities  are  meant  to  address.  Perfor¬ 
mance  (good  or  bad)  in  planned  defense  acquisition  is  intertwined 
with  cost  and  schedule  implications  from  unplanned  responses  to 
these  external  demands.  This  is  not  an  excuse  for  cost  and  sched¬ 
ule  growth,  but  an  observation  from  first  principles  that  chang¬ 
ing  threats  and  needs  can  add  costs  and  delays  relative  to  original 


3  Drezner  and  Smith  (1990,  p.  43)  state,  “An  overly  lengthy  program  can  cost  more  than  a 
shorter  program,  all  other  things  being  equal,  in  large  part  because  of  the  inflation  and  over¬ 
head  allocation,  and  the  opportunity  to  change  requirements.” 
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baselines  as  ongoing  acquisitions  are  adjusted.  (OUSD[AT&L], 

2013,  p.  109) 

Finally,  it  is  important  to  realize  that  these  relationships  are  rarely 
seen  as  bidirectional  (i.e.,  shortening  schedules  probably  will  not  allevi¬ 
ate  a  tight  budget).  While  longer  programs  tend  to  incur  cost  growth, 
a  program  with  an  aggressive  schedule  will  tend  to  incur  both  more 
work  annually  and  added  rush  costs,  thus  yielding  higher  annual  and 
total  costs. 

Can  Acquisition  Schedules  Be  Shortened? 

Long  schedules  may  be  unavoidable  in  high-risk  technology  programs 
because  the  technology  will  take  some  time  to  mature,  and  because 
added  funding  has  limitations  in  shortening  development.  Also,  sched¬ 
ule  slippage  can  occur  in  any  program,  whether  it  involves  high-risk 
technology  or  not  (e.g.,  when  the  planned  schedule  is  unrealistically 
short  for  a  given  task,  or  when  management  issues  arise).  Determining 
an  appropriate  or  optimal  schedule  for  an  acquisition  program,  and 
adhering  to  it,  requires  a  delicate  balancing  act  that  should  include 
taking  into  account  the  program’s  technological  maturity,  complex¬ 
ity,  and  budget.  As  Pernin  and  colleagues  assert  in  their  report,  Lessons 
from  the  Army’s  Future  Combat  Systems  Program, 

Any  acquisition  program  faces  the  dual  risks  that  the  future  capa¬ 
bilities  envisioned  today  may  not  meet  the  actual  operational 
needs  of  tomorrow,  and  that  technological  progress  simply  may 
not  occur  as  quickly  as  anticipated.  The  longer  the  timeline,  the 
more  uncertain  the  future  becomes,  which  amplifies  the  first 
risk;  but  with  more  time  for  technology  to  mature,  in  some  ways, 
a  longer  timeline  also  dampens  the  second  risk.  (Pernin  et  al., 

2012,  p.  52) 

A  longer  timeline,  as  discussed  above,  can  allow  more  time  for  the 
technology  to  mature  in  an  acquisition  program,  but  it  also  allows  the 
program  more  time  to  adjust  to  changes  that  it  may  encounter.  In  some 
cases,  programs  may  experience  negative  consequences  when  accelerat¬ 
ing  acquisition.  For  example,  Flanks  et  al.  (2005)  note  that  speeding 
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up  the  contracting  process  may  lead  to  vagueness  in  the  way  contracts 
are  written,  potentially  causing  problems  with  contractors  who  could 
use  the  ambiguity  to  their  advantage  rather  than  the  government’s.  In 
the  Advanced  Medium-Range  Air-to-Air  Missile  (AMRAAM)  major 
defense  acquisition  program  (MDAP),  shortened  schedules  caused 
design  tasks  to  slip  from  demonstration  and  validation  to  full-scale 
development  to  meet  milestone  dates  (Mayer,  1993).  Others  have 
noted  that  the  emphasis  on  streamlining  and  scheduling  has  also  been 
problematic  because  there  are  not  enough  opportunities  for  trade-offs 
among  cost,  schedule,  and  performance  (see,  for  example,  Hanks  et  ah, 
2005). 

More  rapid  acquisition,  in  addition  to  not  always  being  desir¬ 
able,  is  also  not  always  plausible.  Technological  maturity — specifically, 
when  the  technology  used  in  an  acquisition  program  has  not  reached 
the  planned  level  of  maturity — is  one  of  the  most  widely  cited  causes 
of  lengthy  acquisition  schedules,  but  it  is  not  the  only  roadblock  to 
accelerating  the  acquisition  process.  Aggressively  accelerated  schedules 
require  access  to  higher  yearly  funding  and  other  resources,  which  are 
competed  for  across  portfolios  of  programs  and,  thus,  are  allocated 
based  on  the  priority  of  the  program  within  the  portfolio.  Typically, 
only  high-priority  programs  enjoy  the  resourcing  necessary  to  accom¬ 
modate  an  optimal  schedule  (see,  for  example,  Younossi  et  ah,  2007). 
Additionally,  the  processes  that  regulate  system  acquisition  were  put 
in  place  to  ensure  that  programs  are  managed  effectively  and  in  such  a 
way  that  the  government  receives  high-quality  products.  As  discussed 
later,  there  are  areas  where  these  processes  could  be  improved,  but  as  a 
rule,  these  processes  cannot — and  should  not — be  ignored. 

The  amount  of  time  it  takes  to  deliver  a  system  to  the  end  user 
is  a  function  of  what  is  being  procured  and  how.  DoD  procures  new 
systems  and  upgrades  to  existing  systems.  New  systems  may  be  revo¬ 
lutionary,  evolutions  of  existing  platforms,  or  commercial  products  or 
derivatives.  The  levels  of  design,  development,  and  production  involved, 
and  therefore  of  schedule  risk  and  mitigation,  vary  for  each  type  of  new 
system  or  upgrade. 

Three  interdependent  systems  govern  how  defense  materiel  is 
procured:  the  Joint  Capabilities  Integration  and  Development  System 
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(JCIDS)  Requirements  System  (see  CJCSI  3170.01H,  2012);  the 
resource  allocation  system  known  as  the  Planning,  Programming, 
Budgeting,  and  Execution  System  (see  DoDD  7045.14,  2013);  and 
the  Defense  Acquisition  System  (see  DoDD  5000.01,  2003;  DoDI 
5000.02,  2008;  Interim  DoDI  5000.02,  2013).  The  operation  of  each 
of  these  systems  affects  how  quickly  materiel  needs  can  be  satisfied. 

What  Does  It  Mean  to  "Improve"  a  Schedule? 

If  a  lengthy  acquisition  system  is  unacceptable,  but  universally  accel¬ 
erating  program  schedules  could  lead  to  undesirable  results  and  is  not 
always  feasible,  what  exactly  does  it  mean  to  “improve”  a  schedule? 
Improving  a  schedule  is  about  meeting  the  mission  and  threat  in  a 
more  timely  fashion.  If  this  proves  too  difficult,  then  alternatives  need 
to  be  explored.  In  the  case  of  a  low-risk  program  employing  commer¬ 
cially  available  technologies,  schedule  improvement  may  mean  a  tai¬ 
lored  reporting  and  oversight  process  that  allows  a  program  to  waive 
some  portions  of  the  acquisition  process  that  may  be  more  appropri¬ 
ate  for  a  new-build,  higher-risk  program.  In  the  case  of  a  high-risk 
program  requiring  the  development  and  integration  of  new  technolo¬ 
gies,  schedule  improvement  may  mean  better  risk  management  and 
more  compromises.  These  insights  may  lead  to  decisions  to  reduce  the 
program  scope,  or  even  cancel  the  program,  to  free  up  resources  for 
more  executable  programs.  All  of  these  decisions  are  essentially  about 
reducing  and  managing  risk.  Because  of  heightened  interest  in  reduc¬ 
ing  cycle  times,  this  report  summarizes  published  recommendations 
for  shortening  timelines  (ideally  without  adverse  consequences). 

DoD  schedule  estimation  and  adherence  are  affected  by  many 
factors,  including  some  that  are  internal  and  external  to  program  office 
and  government  control.  Making  the  evaluation  of  schedule  even  more 
complex  are  the  interrelationships  among  these  factors  that  affect  sched¬ 
ule.  For  example,  the  resource  allocation  system  and  acquisition  system 
are  not  mutually  exclusive.  As  a  result,  schedule  activities  cannot  be 
evaluated  in  isolation. 
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Schedule  Improvement  Is  an  Ongoing  Challenge  and  Goal 

Schedule  improvement  is  not  a  new  objective  for  DoD.  Ward  and 
Quaid  (2006,  p.  14)  stated  that  the  “need  to  decrease  the  technol¬ 
ogy  development  timeline  predates  the  Revolutionary  War.”  In  1986, 
the  Packard  Commission  Report  declared  that  “an  unreasonably  long 
acquisition  cycle  ...  is  a  central  problem  from  which  most  other  acqui¬ 
sition  problems  stem”  (Packard  et  ah,  1986,  p.  47).  According  to  the 
commission,  “In  frustration,  many  have  come  to  accept  the  ten-to- 
fifteen-year  acquisition  cycle  as  normal,  or  even  inevitable.  We  believe 
that  it  is  possible  to  cut  this  cycle  in  half”  (Packard  et  ah,  1986,  p.  52). 

The  Government  Performance  and  Results  Act  of  1993  (Pub.  L. 
103-62)  required  government  agencies  to  develop  a  strategic  plan  for 
program  activities  and  to  report  annually  on  performance  goals.  One 
of  DoD’s  early  performance  goals  was  associated  with  improving  acqui¬ 
sition,  including  reducing  cycle  times.  DoD’s  performance  report  for 
fiscal  year  (FY)  2000  claimed  that  the  department  had  accomplished 
its  goal  of  reducing  the  amount  of  time  it  takes  an  MDAP  to  get  from 
program  initiation4  to  IOC  from  132  months  to  under  99  months 
(DoD,  2001,  p.  49).  The  report  cites  advanced  concept  technology 
demonstrations,  integrated  product  teams,  and  “commercially  derived 
items”  as  means  to  achieve  this  goal.  However,  the  DoD  Inspector 
General  reported,  “The  database  used  to  calculate  MDAP  acquisition 
cycle  time  for  inclusion  in  the  FY  2000  Annual  Report  .  .  .  was  not 
accurate  or  complete.”5  We  were  unable  to  identify  a  revised  report 
with  a  new  estimate  for  MDAP  cycle  times.  In  DoD’s  FY  2013  budget 
proposal,  the  cycle  time  goal  was  as  follows:  “5.3.3-2E:  Beginning  in 
FY  2011,  the  DoD  will  not  increase  by  more  than  five  percent  from 
the  Acquisition  Program  Baseline  (APB)  cycle  time  for  Major  Defense 


4  Program  start  was  defined  as  “MS  [milestone]  I,  MS  II  or  MS  III,”  depending  on  the  first 
major  milestone  for  each  individual  acquisition  program. 

5  The  report  continues,  “Of  the  48  MDAPs  reviewed,  data  for  28  programs  was  incorrect. 
We  also  identified  three  programs  that  were  not  included  in  the  database.  As  a  result  of  our 
findings,  USD(AT&L)  has  contracted  for  the  complete  verification  and  reconciliation  of 
any  omissions  and  inconsistencies  in  the  database.  As  of  December  2001,  USD(AT&L)  esti¬ 
mated  that  it  will  complete  the  verification  and  reconciliation  of  the  database  by  February 
2002”  (Office  of  the  Inspector  General,  U.S.  Department  of  Defense,  2001,  p.  i). 
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Acquisition  Programs  (MDAPs)  starting  in  FY  2002  and  after.”  DoD 
reported  that  it  met  its  goal  because  the  actual  cycle  time  increase  in 
FY  2011  was  4.5  percent  (DoD,  2012b). 

The  U.S.  Government  Accountability  Office  (GAO)  has  used 
multiple  methods  over  the  past  40  years  to  examine  cycle  times  and 
schedule  delays,  but  there  has  not  been  a  consistent  reporting  track  or 
data  set  for  the  results.  This  makes  it  difficult  to  draw  broad  conclusions 
about  the  department’s  progress.  One  GAO  report  stated  that  “five 
major  studies,  which  cover  the  period  from  1970  to  1986,  show  that 
the  problems  being  experienced  today  in  the  weapons  acquisition  pro¬ 
cess  are  similar  to  those  of  the  past”  (GAO,  1988,  opening  letter).  Less 
than  ten  years  ago,  GAO  discussed  persistent  problems  that  plagued 
weapons  systems,  concluding  that  “defense  acquisition  programs  in  the 
past  3  decades  continued  to  routinely  experience  cost  overruns,  sched¬ 
ule  slips,  and  performance  shortfalls”  (GAO,  2006,  p.  4). 

The  above  discussion  on  schedule  increases  and  defense  acquisi¬ 
tion  programs  illustrates  two  points: 

1.  There  is  no  consensus  in  the  literature  on  whether  or  not  DoD 
has  improved  its  scheduling  efforts  over  time. 

2.  There  is  widespread  agreement  that  technology  risk  and  manage¬ 
ment  issues  are  the  most  important  causes  of  schedule  slippage. 


Organization  of  This  Report 

Chapter  Two  describes  the  major  themes  in  the  literature  with  respect  to 
sources  of  schedule  growth.  Chapter  Three  discusses  the  major  themes 
in  the  literature  with  respect  to  schedule  growth  mitigation  and  sched¬ 
ule  improvement.  Chapter  Four  presents  some  conclusions  based  on  this 
literature  review.  Finally,  a  case  study  of  the  Mine-Resistant  Ambush- 
Protected  (MRAP)  Vehicle  acquisition  program  is  included  in  the 
appendix.  The  MRAP  acquisition  program,  which  prioritized  schedule 
and  performance,  was  provided  with  significant  resources  and  senior 
leadership  support  to  meet  urgent  needs  in  the  field. 


CHAPTER  TWO 

Sources  of  Schedule  Growth 


In  this  chapter,  we  look  at  the  case  studies  and  expert  opinions  in  the  lit¬ 
erature  regarding  the  causes  of  increased  cycle  time  or  schedule  growth 
in  acquisition  programs.  We  first  offer  a  broad  overview  of  the  prob¬ 
lem  and  then  focus  on  some  of  the  individual  points  covered  by  the 
literature.  The  literature  describing  sources  of  schedule  growth  tends  to 
focus  on  negative,  rather  than  positive,  program  examples.  Thus,  many 
recommendations  for  schedule  improvement  focus  on  avoiding  pitfalls 
rather  than  ways  to  achieve  shorter  cycle  times.  These  pitfalls  are  dis¬ 
cussed  in  this  chapter,  while  cited  recommendations  are  discussed  in 
Chapter  Three. 


Reasons  for  Schedule  Growth 

Recent  work  by  OUSD(AT&L)’s  Performance  Assessments  and  Root 
Cause  Analyses  (PARCA)  office — supported  by  research  by  the  Insti¬ 
tute  for  Defense  Analyses  and  the  RAND  Corporation — focused  on 
uncovering  the  root  causes  of  Nunn-McCurdy  breaches.1  As  a  con¬ 
sequence,  PARCA  has  identified  an  array  of  primary  reasons  for  cost 
growth.  While  a  majority  of  the  findings  and  recommendations  in 
these  analyses  center  around  cost  growth,  the  studies  also  address 
schedule  issues,  such  as  the  causes  and  consequences  of  schedule  slip, 


1  See  Bliss,  2012a,  2012b,  and  2013;  Blickstein  et  al.,  2011;  Blickstein  et  al.,  2012a;  and 
Blickstein  et  al.,  2012b. 
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and  successful  schedule  management  techniques.  Note  that  more  prox¬ 
imal  causes  resulting  from  root  causes  are  not  cited  in  their  analyses. 

In  ten  of  the  18  root-cause  analyses  conducted  on  major  acquisi¬ 
tion  programs  with  critical  cost  growth,  “poor  management  perfor¬ 
mance”  was  the  predominant  root  cause.  This  includes  poor  man¬ 
agement  of  systems  engineering,  contractual  incentives,  risk,  and 
situational  awareness  (OUSD[AT&L],  2013,  p.  34).  Other  root  causes 
included  unrealistic  baseline  costs  and  schedule  estimates,  as  well  as 
changes  in  procurement  quantity.  OUSD(AT&L)’s  study  also  noted 
that  the  following  causes  were  sometimes  found  to  be  the  root  cause  of 
cost  growth  in  the  18  programs  examined  by  PARCA:  immature  tech¬ 
nology;  excessive  manufacturing  or  integration  risk;  unrealistic  per¬ 
formance  expectations;  and  unanticipated  design,  engineering,  man¬ 
ufacturing,  or  technology  issues  (OUSD[AT&L],  2013,  p.  34).  Most 
notably,  “funding  inadequacy  or  instability”  was  not  a  root  cause  of 
critical  growth  in  the  18  programs;  however,  it  has  been  frequently 
asserted  in  other  literature  as  a  cause  of  schedule  growth  in  programs. 
This  difference  may  be  due  to  the  strict  criteria  used  by  PARCA  to 
define  root  causes. 

There  is  some  overlap  in  the  literature  that  touches  upon  the  rea¬ 
sons  for  schedule  slippage  or  growth  in  acquisition  programs  and  PAR- 
CA’s  root  causes  of  cost  growth;  however,  we  discovered  many  addi¬ 
tional  reasons  for  schedule  slippage,  asserted  by  various  authors  and 
organizations.  As  stated  previously,  we  did  not  assess  whether  these 
authors  or  organizations  conducted  sufficient  analysis  to  support  their 
conclusions;  rather,  we  have  tried  to  create  a  compilation  of  what  is 
available  in  the  literature. 

Table  2.1  lists  the  various  reasons  for  longer  cycle  times  and  sched¬ 
ule  growth,  along  with  the  studies  that  cited  them. 

It  should  be  noted  that  rarely,  if  ever,  do  problems  occur  in  isola¬ 
tion.  Schedules  are  typically  subject  to  many  factors  that  may  not  rise 
to  the  level  of  a  root  cause  of  cost  or  schedule  growth  but  could  influ¬ 
ence  the  schedule  of  a  program  nonetheless.  These  factors  include  unre¬ 
alistic  performance  expectations;  unrealistic  baseline  estimates  of  costs 
and  schedules;  immature  technologies  or  excessive  manufacturing  or 
integration  risk;  unanticipated  design,  engineering,  manufacturing,  or 
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Table  2.1 

Possible  Reasons  Cited  in  the  Literature  for  Prolonged  Schedules  and 
Schedule  Slippage 


Area 


Possible  Reason 


Analysis 


Requirements  Infeasible  or  unrealistic 
development,  requirements 
generation, 
and 

management 

Unstable  requirements 
(e.g.,  key  performance 
requirements,  readiness 
requirements, 
reliability  and  support 
requirements) 

Inefficiencies  in 
requirements  process 
(e.g.,  serial  nature 
of  process  and 
requirements  evolution) 


GAO,  2012c;  GAO,  2011a;  Bodilly,  1993; 
Pernin  et  al.,  2012;  Comptroller  General 
of  the  United  States,  1979;  Decker  et  al., 
2011 

Arena,  Birkler,  etal.,  2005;  GAO,  1986c; 
GAO,  2011a;  OUSD(AT&L),  2013,  pp.  BB¬ 
SS 


Decker  et  al.,  2011;  Comptroller  General 
of  the  United  States,  1971;  Pernin  et  al., 
2012 


Managing  Excessive  technical, 

technical  risk  manufacturing, 

or  integration  risk 
(general)  or  program 
complexity 


Blickstein  et  al.,  2011;  Blickstein  et  al., 
2012a;  Blickstein  et  al.,  2013;  GAO,  1979, 
pp.  2,  10;  Tyson  et  al.,  1991;  Drezner  and 
Smith,  1990,  p.  46;  B.  Fox  et  al.,  2004; 
OUSD(AT&L),  2013,  pp.  33-35 


Unanticipated 
design,  engineering, 
manufacturing, 
technical  difficulty,  or 
technology  integration 
issues 


Blickstein  et  al.,  2011;  Blickstein  et  al., 
2012a;  Blickstein  et  al.,  2013;  Drezner  and 
Smith,  1990,  pp.  vii,  44;  GAO,  1986b,  p.  5; 
Cashman,  1995,  pp.  viii,  62;  GAO,  1986c, 
p.  42;  OUSD(AT&L),  2013,  pp.  33-35 


Overly  optimistic 
assumptions/ 
expectations  (technical 
risks,  performance  goals, 
system  requirements,  or 
design  maturity) 


Blickstein  et  al.,  2011;  Blickstein  et  al., 
2012a;  Blickstein  et  al.,  2013;  Glennan 
et  al.,  1993,  p.  xi;  Schinasi,  2008, 
p.  2;  GAO,  1991,  p.  4;  GAO,  2012b; 
OUSD(AT&L),  2013,  pp.  33-35 


Immature  technology  Blickstein  et  al.,  2011;  Blickstein 

et  al.  2012a;  Blickstein  et  al.,  2013; 
OUSD(AT&L),  2013,  pp.  33-35 


Concurrency  in  GAO,  2012a,  p.  10;  Comptroller  General 

complicated  programs  of  the  United  States,  1979,  p.  10;  GAO, 
2012b;  Younossi  et  al.,  2005;  Kendall, 
2012b 
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Table  2.1 — continued 


Area 


Possible  Reason 


Analysis 


Managing  Prototyping 

technical  risk 

(continued) 


Tyson  et  al.,  1991;  Drezner  and  Smith, 
1990;  Kendall,  2012b 


Resource 

allocation 


Deficient  test  planning  Comptroller  General  of  the  United 
or  testing  inefficiencies  States,  1972,  p.  38;  B.  Fox  et  al.,  2004, 
pp.  xxii,  108 


Inadequate  funds  for  GAO,  2011b,  p.  20 
testing 


Funding  instability  or 
budget  cuts 


Drezner  and  Smith,  1990,  p.  vii;  GAO, 
1986c,  p.  42;  J.  R.  Fox,  2011,  p.  98;  GAO, 
1986b,  p.  5;  Kassing  et  al.,  2007,  p.  8; 
GAO,  1991,  p.  4;  Glennan  et  al.,  1993, 
p.  xi;  OUSD(AT&L),  2013,  pp.  33-35 


Defense 

acquisition 

management 


Lack  of  focus  on 
schedule  or  inadequate 
schedule  management 
(e.g.,  underutilization 
of  an  integrated  master 
schedule  [IMS]) 


Anderson  and  Upton,  2012,  p.  36; 
Drezner  and  Smith,  1990;  Farr,  Johnson, 
and  Birmingham,  2005 


Overly  optimistic  GAO,  1986c,  p.  42;  Younossi  et  al.,  2005; 

assumptions/  OUSD(AT&L),  2013,  pp.  33-35 

expectations  in  general, 

including  insufficient 

contingency  funds  in 

program  budgets 


Overly  optimistic 
assumptions/ 
expectations  in  cost  and 
schedule  estimates 


Blickstein  et  al.,  2011;  Blickstein  et  al., 
2012a;  Blickstein  et  al.,  2013;  Glennan 
et  al.,  1993,  p.  xi;  GAO,  2012b;  Mayer, 
1993;  Lorell  and  Graser,  2001;  Younossi 
et  al.,  2008;  GAO,  1986a,  pp.  6-7;  GAO, 
1987,  p.  3;  GAO,  1991,  p.  4;  Comptroller 
General  of  the  United  States,  1971,  p.  21; 
OUSD(AT&L),  2013,  pp.  33-35 


Personnel  issues  Blickstein  et  al.,  2011;  Blickstein  et  al., 

2012a;  Blickstein  et  al.,  2013;  Cashman, 
1995,  p.  viii;  Bodilly,  1993 


Competition  Tyson  et  al.,  1989,  p.  VII-7;  Birkler  et  al., 

2001,  p.  29;  Drezner  and  Smith,  1990; 
Gailey,  2002;  Reig,  1995 


Use  of  UCAs  used  during  OUSD(AT&L),  2013 
development 


Sources  of  Schedule  Growth  17 


Table  2.1 — continued 


Area 

Possible  Reason 

Analysis 

Defense 

Contractor  performance 

Cashman,  1995,  p.  viii 

acquisition 

and  inadequate 

management 

(continued) 

incentives 

Inadequate  tailoring  of 
the  acquisition  process 

Drezner  et  al.,  2011;  Decker  et  al.,  2011 

Other 

Delays  in  obtaining 
necessary  data 

Cashman,  1995,  p.  viii 

technology  integration  issues  arising  during  program  implementation; 
and  poor  performance  by  government  or  contractor  personnel.2  These 
results  highlight  the  sentiment  expressed  in  our  many  discussions  with 
RAND  analysts:  Schedule  management  is  difficult  because  the  sched¬ 
ule  is  intrinsically  tied  to  all  other  aspects  of  acquisition. 

In  addition,  GAO  has  found  that  schedule  slippage  can  occur 
in  all  portions  of  the  acquisition  process.  In  one  report,  GAO  ana¬ 
lyzed  acquisition  programs  from  the  1970s  through  1984.  It  found  that 
“about  30  percent  of  the  total  schedule  slippages  experienced  by  the 
1970’s  systems  occurred  during  the  1980s,”  meaning  that  the  systems 
were  further  along  in  their  acquisition  life  cycles  and  still  experienced 
schedule  slippage  (GAO,  1986b,  p.  5).  Perhaps  unsurprisingly,  a  more 
recent  GAO  report  stated  that  “studies  of  more  than  700  defense  pro¬ 
grams  have  determined  there  is  limited  opportunity  for  a  program  to 
get  back  on  schedule  once  they  are  more  than  15  to  20  percent  com¬ 
plete”  (GAO,  2013,  p.  7). 

Internal  and  External  Activities 

The  literature  also  identifies  issues  and  activities  that  are  internal  and 
external  to  programs  or,  in  other  words,  within  or  outside  of  program 
management  control.  Activities  and  decisions  internal  to  programs 
include  contracting  strategies,  cost  and  schedule  estimation,  and  per¬ 
sonnel  issues. 


2  For  more  examples  of  root  cause  analyses,  see  Blickstein  et  al.,  2011,  and  Blickstein  et  al., 
2012a. 
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Influential  factors  external  to  programs  include  stability  in  fund¬ 
ing  and  requirements,  policy  changes,  and  contractor  performance. 
The  literature  identifies  potential  sources  of  schedule  growth  that  fall 
into  several  broad  categories:  technical  issues;  requirements  develop¬ 
ment,  generation,  and  management;  resource  allocation;  and  program 
management.  Prominent  themes  in  the  literature  include  the  following: 

•  difficulty  managing  technical  risk  (e.g.,  program  complexity, 
immature  technology,  unanticipated  technical  issues) 

•  initial  assumptions  or  expectations  that  are  difficult  to  fulfill  (e.g., 
cost  and  schedule  estimates,  risk,  requirements,  and  performance 
assumptions) 

•  funding  instability. 

The  following  discussion  of  the  literature  on  causes  of  schedule 
growth  and  cycle  time  increases  starts  with  requirements  development, 
generation,  and  management. 


Requirements  Development,  Generation,  and 
Management 

Requirements  development  is  a  major  DoD  process  whereby  capabil¬ 
ity  gaps  and  desired  future  capabilities  are  identified  and  validated. 
The  function  and  intent  of  this  process  has  many  implications  for  a 
program’s  schedule.  There  were  two  ways  identified  in  the  literature  in 
which  requirements  affect  schedule:  (1)  overly  demanding  requirements 
at  the  beginning  of  a  program  and  (2)  requirements  changes  through¬ 
out  a  program.  Requirements  changes  can  be  positive  when  they 
involve  descoping  as  a  recognition  of  overly  ambitious  initial  require¬ 
ments,  or  they  can  be  negative  when  they  add  on  and  change  consis¬ 
tently,  as  in  “requirements  creep.”  GAO  (2012c)  reported  that  infeasi¬ 
ble,  unstable,  or  overly  ambitious  requirements  can  lead  to  rework  and, 
thus,  cost  and  schedule  growth.  Infeasible  or  overly  aggressive  require¬ 
ments  are  also  closely  linked  to  program  risk.  However,  it  is  not  always 
easy  to  identify  whether  the  changes  to  requirements  or  overly  ambi- 
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tious  requirements  are  the  cause  or  effect  of  schedule  growth  and  other 
problems.  A  2011  GAO  report  put  forward  some  assertions  regarding 
the  complexity  of  the  relationship  between  changing  requirements  and 
cost  and  schedule  growth: 

While  changing  requirements  creates  instability  and,  therefore, 
can  adversely  affect  program  outcomes,  it  is  also  possible  that 
some  programs  experiencing  poor  outcomes  may  be  decreasing 
program  requirements  in  an  effort  to  prevent  further  cost  growth. 

.  .  .  [Programs  with  changes  to  performance  requirements  expe¬ 
rienced  roughly  four  times  more  growth  in  research  and  devel¬ 
opment  costs  and  three  to  five  times  greater  schedule  delays 
compared  to  programs  with  unchanged  requirements.  Similarly, 
programs  with  increases  to  key  system  attributes — lower  level, 
but  still  crucial  requirements  of  the  system — experienced  greater, 
albeit  less  pronounced,  cost  growth  and  schedule  delays  than 
other  programs.  (GAO,  2011a) 

Infeasible  or  unstable  requirements  (e.g.,  key  performance  param¬ 
eters,  readiness  requirements,  reliability  and  support  requirements) 
might  be  caused  by  a  variety  of  factors.  A  report  reviewing  22  Acqui¬ 
sition  Category  (ACAT)  I  programs  terminated  since  the  end  of  the 
Cold  War  identified  changes  in  requirements  stemming  from  changes 
in  leadership,  the  reprioritization  or  restructuring  of  programs  (which 
enabled  technology  and  requirements  creep),  optimistic  Technology 
Readiness  Level  (TRL)  assessments,  and  optimistic  technology  inte¬ 
gration  and  manufacturing  readiness  assessments  (Decker  et  ah,  2011). 
The  same  report  identified  the  requirements  process  itself  as  a  source 
of  longer-than-necessary  schedules,  noting  “an  average  of  15  months 
to  staff  a  requirements  document  for  ACAT  I  programs.  The  corre¬ 
sponding  time  to  staff  an  ACAT  II  program  is  18  months,  and  it  is 
22  months  for  an  ACAT  III  program”  (Decker  et  ah,  2011,  p.  35).  In 
an  evaluation  of  shipbuilding  programs,  Arena  et  al.  (2005)  identified 
changing  requirements  in  the  form  of  change  orders  and  late  produc¬ 
tion  definition  to  be  predominant  sources  of  schedule  slip. 

Other  reported  program  experiences  with  regard  to  require¬ 
ments  and  schedule  are  summarized  below.  These  cases  demonstrate 
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challenges  in  the  initial  determination  of  acceptable  levels  of  techni¬ 
cal  risk  and  technological  maturity.  They  show  that  program  manage¬ 
ment  cannot  always  address  such  risks  without  exceeding  initial  cost  or 
schedule  estimates: 

•  The  Air  Force’s  Low-Altitude  Navigation  and  Targeting  Infra¬ 
red  for  Night  (LANTIRN)  program  experienced  schedule  delays 
because  of  ambitious  requirements,  extensive  concurrency,  and  an 
inexperienced  system  program  office  (Bodilly,  1993). 

•  Process  inefficiencies  in  the  Engineering  Change  Proposal  pro¬ 
cess  and  a  user  community  resistant  to  changing  overly  ambitious 
requirements  (i.e.,  the  program’s  framing  assumptions)  led  to  sig¬ 
nificant  schedule  issues  in  the  Future  Combat  Systems  program 
(Pernin  et  ah,  2012). 

•  Two  communication  satellites — Fleet  Satellite  Communication 
System  (FLTSATCOM)  and  the  third  generation  of  the  Defense 
Satellite  Communication  System — faced  developmental  and 
technical  problems  caused  by  design  sophistication,  which  even¬ 
tually  led  to  high  costs  and  schedule  delays.  Additionally,  “ [t]he 
stringency  of  the  Navy’s  and  the  Air  Force’s  communications 
requirements  for  the  FLTSATCOM  satellites  caused  technical 
difficulties  in  the  development  program.  These  difficulties  caused 
cost  overruns  and  schedule  delays”  (Comptroller  General  of  the 
United  States,  1979,  pp.  2-3). 


Resource  Allocation 

Resource  allocation  is  the  DoD  process  that  allocates  funds  to  (in  part) 
procure  and  sustain  the  broad  array  of  materiel  and  equipment  identi¬ 
fied  and  validated  by  the  requirements  process  (DoDD  7045.14,  2013). 
While  a  description  of  this  process  falls  outside  the  scope  of  this  report, 
the  function  and  intent  of  the  process  has  many  implications  for  pro¬ 
gram  schedules.  Most  notably,  various  reports  have  asserted  that  the 
instability  of  program  funding  or  budget  cuts  may  lengthen  schedules. 
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The  resource  allocation  process,  like  the  requirements  generation 
process,  is  lengthy.  The  Future  Years  Defense  Program  is  typically  for¬ 
mulated  every  other  year  and  covers  a  period  of  six  years.  The  services 
begin  working  on  the  program  three  years  before  the  first-year  funds 
are  appropriated  (DoDD  7045.14,  2013).  The  underlying  assump¬ 
tion  is  that  the  services  can  identify  what  they  will  need  in  three  years 
and  that  those  funding  requirements  will  remain  stable.  McCaffrey 
and  Jones  (2005)  reported  that  it  is  unlikely  that  the  costs  of  weapon 
systems  estimated  three  years  prior  would  reflect  actual  costs.  While 
changes  can  be  made  to  the  Future  Years  Defense  Program,  this  nor¬ 
mally  occurs  only  twice  a  year — in  August  or  September  and  in  Janu¬ 
ary  of  the  following  calendar  year  (Fast,  2010).  The  length  of  this  pro¬ 
cess  and  limitations  on  changes  make  it  difficult  to  adjust  program 
funding  for  “fact-of-life”  changes  in  a  timely  manner,  requiring  fund¬ 
ing  and  program  requirements  to  be  forecast  accurately. 

In  addition  to  the  challenges  associated  with  ensuring  appropriate 
funds,  programs  can  face  funding  instability  stemming  from  multiple 
sources  (e.g.,  congressionally  mandated  budget  cuts,  reprioritizations 
within  service  portfolios,  comptroller  reallocations  of  unobligated  pro¬ 
gram  funds).  Drezner  and  Smith  (1990)  found  that  factors  external  to 
the  program  (including  funding  stability)  can  have  a  profound  effect 
on  program  length.  In  two  case  studies  of  Army  programs  conducted 
by  Kassing  et  al.  (2007),  funding  instability  came  from  two  sources: 
events  that  occurred  outside  the  control  of  Army  leaders  and  ambi¬ 
tious  technical  goals  set  by  the  Army.  In  their  case  study  on  the  Javelin 
program,  “the  program  approved  for  development  of  the  Javelin  mis¬ 
sile  system  in  1989  was  recognized  as  ambitious  at  the  time.  Technical 
problems  followed,  and  the  development  schedule  had  to  be  extended, 
resulting  in  what  was  high  development  funding  instability  by  our 
measure.  In  addition,  before  the  Javelin  could  move  into  production, 
the  Cold  War  ended,  Army  forces  were  cut,  and  the  Javelin  procure¬ 
ment  objectives  were  cut  nearly  in  half.  These  ‘fact  of  life’  changes  led 
to  high  procurement  funding  instability”  (Kassing  et  al.,  2007,  p.  xvii). 
However,  in  this  same  analysis,  the  authors  found  only  a  small  but  pos¬ 
itive  statistical  association  between  total  funding  instability  and  sched- 
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ule  slippage,  pointing  out  that  funding  instability  can  be  either  a  cause 
or  effect  of  other  problems  (Kassing  et  ah,  2007,  p.  86). 

In  addition,  Ronald  J.  Fox  has  asserted  that  funding  levels  and 
annual  budget  fluctuations  have  caused  schedule  and  other  prob¬ 
lems,  particularly  in  the  Cold  War  era,  when  “changing  funding  levels 
prompted  by  annual  budget  fluctuations  often  led  to  inefficient  pro¬ 
duction  rates  and  schedule  slippages  in  key  weapons  programs  con¬ 
tracted  out  to  industry”  (R.  J.  Fox,  2011,  p.  98). 


Technical  Risk 

According  to  a  GAO  report  published  in  1979,  excessive  technical  risk 
has  been  “probably  the  single  most  significant  factor  leading  to  weapon 
failures,  cost  growth  and  overrun,  production  interruption  or  shut¬ 
down,  production  inefficiency,  and  schedule  slippages”  (GAO,  1979, 
p.  10).  One  source  of  technical  risk  is  the  use  of  immature  technol¬ 
ogy.  Excessive  concurrency  can  increase  the  cost  of  fixing  problems 
incurred  by  prematurely  entering  into  production  or  the  next  program 
phase  before  the  technology  and  design  have  fully  matured.  Prototyp¬ 
ing  can  mature  the  technology,  and  early  testing  can  identify  problems 
when  they  are  easier  to  correct.  These  management  considerations  have 
all  been  found  to  carry  schedule  implications.  However,  defense  acqui¬ 
sition  is  about  pushing  the  state  of  the  art,  so  some  of  these  risks  will 
always  be  present  in  programs. 

Because  many  aspects  of  the  acquisition  process  exist  primarily  to 
manage  technical  risk,  technical  issues  are  intrinsically  tied  to  several 
other  schedule-influencing  factors.  A  2005  literature  review  published 
in  the  Defense  Acquisition  Review  Journal  examined  a  dozen  studies 
describing  sources  of  schedule  slippage,  Ending  the  most  commonly 
cited  source  of  schedule  slippage  to  be  technical  in  nature  (Monaco 
and  White,  2005).  Competition,  prototyping,  and  contract  type  were 
the  other  most  prevalent  topics  discussed  with  regard  to  schedule.  In  a 
review  of  ten  acquisition  programs,  Drezner  and  Smith  (1990,  p.  44) 
identified  technical  difficulties  as  among  the  factors  with  the  most 
profound  impact  on  program  length.  In  an  effort  to  identify  sources 
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of  schedule  problems  across  large  U.S.  Air  Force  system  development 
efforts,  Cashman  (1995)  cited  technical  problems,  delays  at  the  sub¬ 
contractor  level,  delays  in  getting  necessary  data,  manufacturing  prob¬ 
lems,  and  staffing  problems  as  the  five  most  common  sources  of  sched¬ 
ule  growth.  However,  he  clarified  that  the  most  common  sources  are 
not  necessarily  the  most  problematic  in  terms  of  the  amount  of  dollars 
and  time  associated  with  the  slip,  meaning  that  it  is  useful  to  account 
for  relative  importance.  He  found  technical  problems  and  subcontrac¬ 
tor  delays  to  be  associated  with  the  greatest  dollar  values,  while  prob¬ 
lems  with  subcontractor  performance  and  manufacturing  had  the  larg¬ 
est  negative  impact  in  terms  of  time.  Technical  issues  are  logically  tied 
to  the  amount  of  technical  risk  that  the  program  can  handle,  which  is 
influenced  by  several  program  characteristics,  including  the  feasibility 
and  stringency  of  the  specific  technical  and  design  solution  chosen  to 
meet  the  requirement.  Most  other  program  characteristics  that  influ¬ 
ence  technical  risk  fall  within  the  purview  of  the  acquisition  man¬ 
agement  system.  For  example,  sometimes  the  component  technolo¬ 
gies  may  be  fairly  mature,  but  the  integration  of  the  technologies  may 
be  extremely  challenging,  as  is  the  case  in  the  Space-Based  Infrared 
System  (SBIRS)  satellite  program. 

Technology  Complexity  and  Maturity 

One  of  the  major  sources  of  technical  risk  is  the  use  of  complicated  and 
immature  technologies.  While  many  argue  that  program  durations  are 
getting  longer  (OUSD[AT&L],  2013),  it  is  often  pointed  out  that  pro¬ 
gram  complexity  is  also  increasing,  and  this  increasing  complexity  may 
be  at  fault  for  longer  program  timelines  (Drezner,  2009,  p.  32).  Bernard 
Fox  and  colleagues  suggest  a  relationship  between  weapon  system  com¬ 
plexity  and  schedule  duration:  “As  military  systems  have  become  more 
complex,  testing  has  become  more  time  consuming  and  costly”  (B.  Fox 
et  ah,  2004,  abstract). 

GAO  suggests  that  a  majority  of  programs  are  employing  tech¬ 
nology  that  is  nearing  maturity,  but  not  fully  mature,  prior  to  entering 
system  development  (GAO,  2012a).  Specifically,  in  an  annual  review 
of  a  sample  of  62  programs  in  2007,  GAO  found  that  only  16  percent 
had  achieved  technology  maturity  at  Milestone  B.  It  also  found  that  at 
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the  start  of  production  (Milestone  C),  only  67  percent  of  the  programs 
sampled  had  achieved  technology  maturity  (GAO,  2007). 

Several  analyses  performed  by  Blickstein  and  colleagues  (2011, 
2012a,  2012b,  and  2013)  have  identified  immature  technology  as  a 
significant  (but  not  the  only)  factor  in  program  problems.  Program 
examples  include  the  DDG-1000  destroyer,  the  Joint  Strike  Fighter 
(JSF),  the  Wideband  Global  Satellite  Communication  System,  Excali- 
bur,  and  Apache  Block  III. 

The  importance  of  technological  maturity  in  timely  delivery  has 
also  been  underscored  by  commercial  experience,  an  example  being 
Boeing’s  recent  experience  developing  the  787  Dreamliner.  The  Dream¬ 
liner  was  designed  to  improve  fuel  efficiency  and  ensure  a  smoother, 
quieter,  and  more  comfortable  ride  for  passengers.  These  improvements 
required  a  substantial  increase  in  the  amount  of  composite  materials 
relative  to  older  airframes,  as  well  as  new  manufacturing  techniques. 
At  the  same  time,  in  an  effort  to  cut  costs,  Boeing  outsourced  much 
of  its  manufacturing  and  supply.  The  resulting  effects  on  development 
and  production  schedules  have  been  less  than  favorable:  The  program 
has  seen  several  substantial  delays — nearly  three  years  in  total — caused 
by  supply  shortages,  production  delays,  and  testing  problems.  In  2010, 
after  a  fire  grounded  a  test  fleet,  Boeing’s  chief  executive  officer,  Jim 
McNerney,  said,  “In  retrospect,  our  787  game  plan  may  have  been 
overly  ambitious,  incorporating  too  many  firsts  all  at  once — in  the 
application  of  new  technologies,  in  revolutionary  design-and-build 
processes,  and  in  increased  global  sourcing  of  engineering  and  manu¬ 
facturing  content”  (Peterson,  2011). 

Concurrency 

Concurrency  is  a  strategy  in  which  development  and  production  activi¬ 
ties  partially  overlap  in  time,  rather  than  being  performed  sequentially, 
with  the  intent  to  compress  program  timelines  and  (ideally)  reduce 
costs.  Some  modest  amount  of  concurrency  is  usually  prudent,  but 
how  soon  concurrency  should  be  initiated  to  balance  risk  continues  to 
be  a  point  of  debate  and  management  attention: 
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Concurrency  is  broadly  defined  as  the  overlap  between  technol¬ 
ogy  development  and  product  development  or  between  product 
development  and  production.  While  some  concurrency  is  under¬ 
standable,  committing  to  product  development  before  require¬ 
ments  are  understood  and  technologies  mature  or  committing 
to  production  and  fielding  before  development  is  complete  is  a 
high-risk  strategy  that  often  results  in  performance  shortfalls, 
expected  cost  increases,  schedule  delays,  and  test  problems.  It  can 
also  create  pressure  to  keep  producing  to  avoid  work  stoppages. 
(GAO,  2012b) 

Such  overlaps  can  sometimes  reduce  the  overall  time  required  for 
development  and  production,  but  they  also  carry  risks:  When  design 
and  development  problems  surface  after  production  has  begun,  units 
already  produced  need  to  undergo  costly  retrofits  (if  they  are  even  pos¬ 
sible),  adding  cost  and  time  (GAO,  1979,  p.  10).  Overlaps  can  also 
cause  programs  to  produce  units  that  are  not  cost-effective  to  retrofit 
and  are  either  inferior  or  not  operational.  The  role  of  concurrency  in 
schedule  performance  is  intricately  tied  to  the  level  of  technical  risk 
remaining  in  a  program’s  design:  When  design  risks  are  low,  concur¬ 
rency  can  shorten  schedules  for  delivering  operational  units  at  either 
reduced  or  modest  cost;  when  technical  risks  are  high  and  borne  out, 
concurrency  can  lead  to  numerous  problems,  including  cost  and  sched¬ 
ule  growth. 

The  F-35  JSF  program  is  a  recent  example  of  a  program  that  had 
a  significant  level  of  concurrency  that  resulted  in  problems  (Kendall, 
2012b;  Kendall  et  ah,  2012).  The  F-22  program  is  another  example  in 
which  concurrency  reportedly  contributed  to  schedule  growth.  Sev¬ 
eral  F-22  design  challenges — related  to  the  advanced  technology  being 
employed  but  underestimated  or  unaccounted  for  in  original  program 
plans — caused  cost  growth  and  delays.  These  difficulties  were  substan¬ 
tially  compounded  by  concurrency  in  development  and  integration, 
which  likely  led  to  further  delays  (Younossi  et  ah,  2005).  The  GAO  also 
reported  that,  because  of  high  levels  of  concurrency,  a  design  problem 
in  the  Missile  Defense  Agency’s  Ground-Based  Midcourse  Defense 
program  was  discovered  after  production  was  under  way.  The  result, 
according  to  GAO  (2012b),  was  significant  cost  and  schedule  growth, 
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as  well  as  potential  retrofits  to  fielded  equipment.  GAO  has  also  warned 
that  several  current  programs — JSF,  SBIRS  High,  and  Apache  Block 
IIIA  Remanufacture — are  at  increased  manufacturing  risk  because  of 
their  concurrent  development  and  production  strategies  (GAO,  2012a, 
p.  10).  OUSD(AT&L)  also  reported  that  “first  principl  es  indicate  that 
concurrent  production  when  designs  are  unstable  can  impose  added 
retrofit  costs  for  early  production  products.  Further  analysis  of  past 
performance  will  provide  an  objective  foundation  for  informing  future 
policies  and  acquisition  decisions”  (OUSD[AT&L],  2013,  p.  109). 

Prototyping  and  Testing 

Prototyping  has  been  identified  as  a  potential  means  for  reducing  tech¬ 
nical  and  manufacturing  risks  (see,  for  example,  Tyson  et  ah,  1991). 
Prototyping  can  mature  the  technology,  and  testing  can  identify  prob¬ 
lems  early  and  determine  the  remaining  level  of  risk.  Unfortunately, 
the  implications  for  program  schedule  resulting  from  prototyping 
efforts  are  mixed.  Drezner  and  Smith  (1990)  reported  that  prototyping 
lengthens  schedules,  yet  other  studies  have  identified  prototyping  activ¬ 
ity  that  reduced  schedules  (see,  for  example,  Tyson  et  ah,  1991),  while 
still  others  found  no  such  relationship  (see,  for  example,  Nelson  and 
Trageser,  1987;  Tyson  et  ah,  1989;  Harmon  et  ah,  1989).  The  counter- 
factual  is  difficult  to  assess,  however:  It  is  unclear  whether  the  technical 
risks  resolved  in  prototyping  would  have  led  to  greater  program  length 
than  the  additional  time  it  took  to  complete  the  prototyping  activities. 
It  also  depends  on  what  is  prototyped.  For  example,  the  competitive 
prototyping  in  the  JSF  program  tested  only  some  characteristics  of  the 
fighter  airframe  and  propulsion  designs.  Risk  was  probably  reduced  in 
these  areas,  but  not  in  many  others.  Further,  prototyping  is  not  likely 
to  significantly  reduce  the  system  integration  risk,  since  full  integration 
amounts  to  full-scale  development. 

In  a  review  of  Air  Force  programs,  Bernard  Fox  et  al.  (2004)  sug¬ 
gest  that  the  increasing  complexity  of  military  systems  has  led  to  longer 
and  more  costly  testing  programs.  The  authors  recommend  more  test¬ 
ing,  which  should  be  accounted  for  in  the  original  schedule.  This 
may  increase  cycle  times  but  might  not  necessarily  increase  schedule 
growth,  if  the  original  scheduling  is  accurate.  The  authors  also  suggest 
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that  the  relationship  between  schedule  duration  and  testing  is  nuanced 
because  “most  T&E  expenditures  occur  in  the  later  stages  of  develop¬ 
ment,  when  cost  overruns  and  schedule  slips  from  other  activities  may 
have  become  more  apparent.  As  a  result,  there  is  often  considerable 
pressure  to  expedite  and/or  reduce  T&E  activities  to  recoup  some  of 
the  other  overruns.”  The  report  also  describes  how  “government  test 
range  personnel  were  not  as  focused  on  controlling  the  costs  and  sched¬ 
ule  of  the  test  program  as  other  members  of  the  test  team  were”  (B.  Fox 
et  ah,  2004,  p.  xxii).  Some  individuals  interviewed  suggested  that  some 
test  procedures  could  be  changed  to  “improve  the  pace  and  efficiency 
of  the  typical  test  program,”  suggesting  inefficiencies  in  the  testing  pro¬ 
cess  (B.  Fox  et  ah,  2004,  p.  xxiii). 

The  Office  of  the  Comptroller  General  (the  predecessor  to  GAO) 
has  also  asserted  that  some  weapon  systems  can  have  schedule  growth 
caused  by  “deficient  test  planning.”  It  reported  that  some  test  sched¬ 
ules  assumed  that  only  minimal  problems  would  surface  during  test¬ 
ing,  schedules  lacked  contingencies,  and  planned  testing  environments 
were  inadequate  for  proving  operational  utility  because  this  type  of 
testing  was  completed  too  late  in  the  process  (Comptroller  General 
of  the  United  States,  1972,  p.  38).  In  a  more  recent  study,  the  GAO 
reported  that  inadequate  funding  of  developmental  testing  was  a  source 
of  cost  and  schedule  growth,  and  that  limiting  the  amount  of  testing 
performed  increases  program  risk  and  could  “result  in  an  extension  of 
a  program’s  test  schedule”  (GAO,  2011b,  p.  20). 


Defense  Acquisition  Management:  Practices,  Policies,  and 
Procedures 

According  to  DoD  Directive  5000.01  (2003),  “The  Defense  Acqui¬ 
sition  System  exists  to  manage  the  nation’s  investments  in  technolo¬ 
gies,  programs,  and  product  support  necessary  to  achieve  the  National 
Security  Strategy  and  support  the  United  States  Armed  Forces,”  with  a 
primary  objective  of  “acquiring  quality  products  that  satisfy  user  needs 
with  measurable  improvements  to  mission  capability  and  operational 
support,  in  a  timely  manner,  and  at  a  fair  and  reasonable  price.”  Man- 
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aging  these  investments  involves  several  challenges,  including  devel¬ 
oping  and  adhering  to  realistic  schedule  estimates,  establishing  an 
acquisition  approach  that  incentivizes  contractors  and  is  appropriately 
tailored  to  the  program’s  needs,  and  managing  the  risks  inherent  in 
technology  development.  As  discussed  below,  these  challenges,  if  not 
handled  appropriately,  can  cause  numerous  problems,  including  sched¬ 
ule  growth. 

Program  Management:  Schedule  Estimation  and  Management 

Historically,  schedule  estimation  and  management  have  not  received 
the  same  level  of  attention  as  cost  estimation  and  management  within 
DoD.  Anecdotally,  many  have  noted  a  lack  of  priority  schedule  adher¬ 
ence  receives  in  program  management  (see,  for  example,  Anderson 
and  Upton,  2012,  p.  36);  others  have  blamed  this  lack  of  emphasis  on 
schedule  adherence  on  deteriorated  program  control  competency3  and 
a  lack  of  accountability  for  timelines  (for  example,  Drezner  and  Smith, 
1990;  Farr,  Johnson,  and  Birmingham,  2005).  According  to  Michael 
Sullivan  of  GAO, 

Most  program  managers  seem  focused  on  controlling  costs  and 
delivering  a  quality  product.  The  third  leg  of  the  acquisition  stool 
‘program  schedule’  is  perceived  to  be  less  important  and  seems  to 
be  a  resource  that  can  be  slipped  to  accommodate  unstable  fund¬ 
ing  or  technical  difficulties  when  they  are  encountered.  Given 
that  most  major  defense  program  schedules  span  years  or  even 
decades,  schedule  slips  are  less  likely  given  their  importance.  (Sul¬ 
livan,  2012,  p.  23) 

According  to  Farr,  Johnson,  and  Birmingham  (2005,  p.  237), 
“The  lack  of  schedule  focus  creates  a  culture  that  has  historically  called 
for  a  total  system  solution  despite  notorious  requirements  creep  and  a 
never-ending  component  to  sub  system-to-system  test.”  Also,  if  achiev¬ 
ing  requirements  is  the  highest  priority,  then  cost  growth  and  schedule 


3  Program  control  competency  includes  the  ability  to  use  and  manage  tools,  which  helps 
with  the  development  and  management  of  schedule. 
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slippage  can  result  when  encountering  technical  difficulties  and  fund¬ 
ing  shortfalls. 

Perhaps  because  of  this  lack  of  focus  on  schedule  or  the  difficulties 
inherent  in  schedule  estimating,  robust  schedule-estimation  method¬ 
ologies  have  not  been  as  extensively  developed  as  cost-estimation  meth¬ 
odologies.  A  2012  survey  of  current  program  managers  revealed  that  a 
vast  majority  believed  that  an  integrated,  up-to-date  schedule  is  a  criti¬ 
cal  component  of  successful  program  management,  but  fewer  than  50 
percent  were  confident  that  their  schedules  were  accurately  resource- 
loaded.  Only  51  percent  believed  that  all  government  and  contractor 
workload  was  included  in  their  schedule  (Sullivan,  2012,  p.  23). 

In  addition  to  potential  inadequacies  in  schedule  estimating  and 
a  lack  of  focus  on  schedule,  the  literature  reports  cases  in  which  pro¬ 
gram  schedules  have  suffered  negative  effects  from  excessive  optimism. 
For  example,  OUSD(AT&L)’s  Performance  of  the  Defense  Acquisition 
System:  2013  Annual  Report  contains  a  summary  of  root-cause  analy¬ 
ses  of  critical  cost  growth  in  18  programs:  “Baseline  cost  and  schedule 
estimates  were  unrealistic  in  just  over  one-fourth  of  the  cases.  The  pri¬ 
mary  underlying  reason  was  invalid  framing  assumptions.  .  .  .  Fram¬ 
ing  assumptions  are  any  explicit  or  implicit  assumptions  central  in 
shaping  cost,  schedule,  and/or  technical  performance  expectations” 
(OUSD[AT&L],  2013,  p.  34).  In  an  earlier  report,  GAO  found  “that 
overly  optimistic  assumptions  about  technical  risks  were  common  fac¬ 
tors  in  [cost  and  schedule]  overruns”  (GAO,  1991,  p.  4).  Another  study 
identified  ambitious  schedules,  budgets  without  contingency  funds, 
and  a  reluctance  to  adjust  ambitious  performance  goals  as  factors  that 
may  influence  schedule  (Glennan  et  ah,  1993).  Ambitious  schedules 
that  do  not  account  for  risks  can  set  up  a  program  to  not  meet  its  origi¬ 
nal  schedule.  Reports  cite  cases  in  which  such  problems  have  occurred 
as  a  result  of  program  advocacy,  bureaucratic  pressure,  and  operational 
urgency: 

•  Mayer  (1993)  reported  that  the  AMRAAM  program  vastly  over¬ 
sold  itself  in  terms  of  cost  and  schedule.  Early  cost  estimates  may 
have  been  made  for  advocacy  reasons,  and  the  schedule  was  com¬ 
pressed  (from  90  to  70  months)  in  response  to  congressional  pres- 
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sure.  This  compressed  schedule  caused  design  tasks  to  slip  from 
the  demonstration  and  validation  phase  of  the  program  to  full- 
scale  development.  Eventually,  a  gap  between  what  was  advertised 
and  what  was  achieved  emerged  due  to  technical  problems. 

•  Lorell  and  Graser  (2001)  found  that  an  overly  aggressive  sched¬ 
ule  was  a  likely  cause  of  cost  growth  and  schedule  restructuring 
for  the  SBIRS  program.  Despite  stable  requirements  for  SBIRS 
High,  Younossi  et  al.  (2008)  found  that  most  of  the  program’s 
cost  growth  was  due  to  inappropriate  cost  and  schedule  estimates 
made  by  the  contractor  and  accepted  by  government. 

•  Blickstein  et  al.  (2011)  reported  that  “ambitious  schedule  esti¬ 
mates”  were  one  of  several  proximal  causes  of  cost  growth  in  the 
DDG-1000  and  JSF  programs. 

•  Bodilly  (1993)  determined  that  LANTIRN  program  plans 
included  ambitious  goals  that  were,  in  part,  responsible  for  the 
program’s  schedule  slips.  These  goals,  motivated  by  the  need  to 
fulfill  an  urgent  requirement,  included  technical  ambitions  far 
beyond  those  that  would  have  been  supported  by  the  technical 
base  at  the  time. 

•  According  to  GAO  (1986a,  pp.  6-7),  in  the  Army’s  accelerated 
Sergeant  York  air  defense  system  acquisition  program,  “Techni¬ 
cal  difficulties  can  be  encountered  in  developing  any  complex 
system,  irrespective  of  the  acquisition  strategy  used.  However,  the 
Sergeant  York’s  tight  schedule  and  the  limited  operational  test¬ 
ing,  both  of  which  were  critical  elements  of  the  strategy,  left  few 
opportunities  to  resolve  these  difficulties  before  major  production 
commitments  were  made.” 

Personnel  issues  have  also  reportedly  caused  schedule  slips.  Indi¬ 
viduals  with  whom  we  spoke  asserted  that  details  about  personnel 
issues  are  not  publicly  releasable  because  of  personnel  restrictions  and 
thus  are  not  well  documented.  However,  Bodilly  (1993)  found  that 
schedule  slips  in  the  Air  Force’s  LANTIRN  program  were  caused  not 
only  by  ambitious  requirements,  as  discussed  above,  but  also  by  exten¬ 
sive  concurrency  and  an  inexperienced  system  program  office.  Finally, 
Cashman  (1995)  identified  delays  at  the  subcontractor  level,  delays  in 
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getting  necessary  data,  manufacturing  problems,  and  staffing  problems 
as  four  of  the  five  most  common  sources  of  schedule  growth. 


Acquisition  Approach 

The  acquisition  system  utilizes  several  practices  that,  according  to  some 
reports,  may  optimize  technical  performance  or  cost  over  cycle  time  or 
schedule  growth. 

Competition 

Promoting  effective  competition  is  one  of  the  main  tenets  of  the  BBP 
initiative  (see  Carter,  2010b)  and  has  been  stressed  in  nearly  all  acqui¬ 
sition  reform  initiatives  over  the  past  40  years  as  a  means  for  achiev¬ 
ing  best  value  and  innovation.  The  benefits  of  competition  are  widely 
publicized  but  do  not  necessarily  include  shorter  schedules.  In  describ¬ 
ing  the  benefits  of  competition,  Birkler  et  al.  (2001)  cited  improved 
product  quality,  lower  unit  costs,  technological  progress,  and  improved 
industrial  productivity.  While  improved  productivity  and  technologi¬ 
cal  progress  may  lead  to  shorter  schedules,  Birkler  et  al.  (2001)  have 
suggested  that  the  competitive  process  requires  “additional  time  and 
money  and  entails  extra  management  complexity  and  effort”  (p.  29). 
Other  studies  have  also  suggested  that  competition  may  lengthen  sched¬ 
ules  (Drezner  and  Smith,  1990,  p.  43;  Tyson  et  al.,  1989,  p.  VII-7). 

Undefinitized  Contract  Actions 

OUSD(AT&L)’s  Performance  of  the  Defense  Acquisition  System:  2013 
Annual  Report  found  that  UCAs  in  development  (but  not  in  early  pro¬ 
duction)  “had  a  measurable  increase  on  total  contract  cost  growth  and 
also  on  cycle  time  in  development  ....  A  contract  with  a  UCA  gener¬ 
ally  lasted  0.3  years  longer  (all  other  things  being  equal),  as  measured 
across  all  DoD  contracts  from  1970-2011.  Thus,  UCAs  increase  devel¬ 
opment  cycle  time  by  increasing  schedule  growth”  (OUSD[AT&L], 
2013,  p.  54). 
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Tailoring  the  Acquisition  Process 

DoD  Instruction  5000.02  on  the  operation  of  the  defense  acquisi¬ 
tion  system  allows  the  tailoring  of  program  requirements — such  as 
reporting  and  documentation — to  meet  the  needs  of  a  given  program 
(DoDI  5000.02,  2008).  This  includes  programs  whose  products  must 
be  acquired  more  rapidly  than  normal.  However,  research  suggests  that 
tailoring  acquisition  may  be  difficult  at  times  and  not  well  incentivized 
(Drezner  et  ah,  2011).  Anecdotal  reporting  gathered  by  Drezner  et  al. 
(2011)  suggests  that  process  tailoring  is  sufficient  to  address  the  unique 
requirements  of  ships,  but  many  others  have  said  that  they  found  tai¬ 
loring  difficult.  Instructions  dating  from  2008  may  be  insufficient  or 
unclear,  and  much  of  the  tailoring  burden  is  handled  through  infor¬ 
mal  processes  (such  as  coordination)  and  is  therefore  difficult  to  rec¬ 
ognize,  measure,  and  anticipate  (Drezner  et  ah,  2011).  Other  research 
has  reported  that  there  can  be  few  incentives  for  the  program  manager 
to  tailor  a  program’s  acquisition  strategy  to  take  on  the  risk  associated 
with  streamlining  parts  of  the  acquisition  process,  noting  a  lack  of  tai¬ 
loring  guidance  and  specific  training  to  implement  such  guidance.  In 
the  2010  Army  Acquisition  Review,  Decker  et  al.  (2011)  found  that 
the  Army  acquisition  system  at  the  time  allowed  for  tailoring  but  then 
required  each  program  to  “perform  all  the  steps  and  produce  all  the 
documentation  of  the  most  complex,  technically  challenging  develop¬ 
ment,”  effectively  making  tailoring  infeasible.  In  the  case  of  informa¬ 
tion  technology  programs,  a  Defense  Science  Board  Task  Force  found 
that  tailoring  in  the  extant  acquisition  process  has  not  produced  suf¬ 
ficiently  shorter  timelines  (DSB,  2009a).  In  response,  the  task  force  for 
the  acquisition  of  information  technology  (IT)  recommended  a  new 
acquisition  process  for  IT  systems  to  keep  up  with  the  rapidly  advanc¬ 
ing  industry  (DSB,  2009a).  Better  Buying  Power  (BBP)  2.0  recognizes 
this  critique  and  tries  to  promote  better  use  of  tailoring,  and  a  forth¬ 
coming  update  to  the  DoDI  5000.02  may  include  additional  support 
for  tailoring. 
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Other  Factors  Outside  of  Program  Management  Control 

Drezner  and  Smith  identified  that  external  guidance  (such  as  OSD 
or  congressional  direction,  reviews,  restrictions,  and  designations)  and 
events  (such  as  inflation,  strikes,  and  natural  disasters)  cause  delays 
on  the  order  of  one  year  and  that  increased  program  stability  (fund¬ 
ing,  requirements,  and  guidance)  leads  to  better  schedule  performance 
(Drezner  and  Smith,  1990,  p.  43). 


CHAPTER  THREE 


Improving  Schedule  Performance 


In  this  chapter,  we  present  specific  analyses  and  program  experiences 
that  have  claimed  to  provide  strategies  and  mechanisms  for  improv¬ 
ing  schedule  performance.1  We  present  a  broad  overview  of  possible 
solutions  offered  by  the  literature  and  then  focus  on  individual  areas 
of  schedule  performance  that  experts  have  specifically  identified  for 
improvement. 


Successful  Practices  That  May  Not  Be  Applicable  to  All 
Programs 

The  suggested  mechanisms  for  improving  schedule  performance  follow 
from  the  identified  causes  of  schedule  slip.  The  most  common  recom¬ 
mendations  for  reducing  cycle  time  are  strategies  to  manage  technical 
risk.  One  recommendation  is  to  use  incremental  fielding  and  evolu¬ 
tionary  acquisition  (EA)  strategies,  when  appropriate,  and  to  develop 
derivative  products  rather  than  brand-new  designs  (see,  for  example, 
Interim  DoDI  5000.02,  2013;  Boehm  et  ah,  2010;  GAO,  2003).  Other 
possible  approaches  include  maintaining  stable  funding  (GAO,  2010; 
Kassing  et  ah,  2007;  Johnson,  1999;  OUSD(AT&L),  2013)  and  using 
tailored  contracting  vehicles,  as  appropriate  (GAO,  2012c;  Green¬ 
house,  2000;  OUSD(AT&L),  2013).  A  summary  of  the  broad  range 
of  approaches  to  improving  program  performance  is  provided  in  the 


1  In  this  report,  we  do  not  examine  whether  these  strategies  will  work  for  programs  or 
under  what  specific  conditions;  rather,  we  report  what  is  available  in  the  literature. 
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GAO  report  Defense  Acquisitions :  Strong  Leadership  Is  Key  to  Planning 
and  Executing  Stable  Weapon  Programs  (GAO,  2010,  p.  1).  The  GAO 
lists  various  characteristics  of  programs  that  were  on  track  with  origi¬ 
nal  cost  and  schedule  goals.  Common  themes  in  these  programs — 
such  as  having  senior  leadership  support,  program  priority,  program 
stability,  incremental  fielding  and  EA  strategies,  mature  technology, 
and  realistic  schedule  estimates — are  confirmed  elsewhere  in  the  lit¬ 
erature;  however,  caution  needs  to  be  exercised  when  applying  these 
strategies  because  they  do  not  work  necessarily  for  all  programs.2  In 
fact,  there  are  strategies  (for  example,  prototyping  and  concurrency) 
that  can  either  cause  schedule  growth  or  shorten  schedules,  depend¬ 
ing  on  the  unique  circumstances  of  each  acquisition  program  and  how 
well  the  approach  is  applied.  According  to  GAO,  “These  practices  are 
in  contrast  to  prevailing  pressures  to  force  programs  to  compete  for 
funds  by  exaggerating  achievable  capabilities,  underestimating  costs, 
and  assuming  optimistic  delivery  dates”  (GAO,  2010,  p.  1). 

GAO  has  documented  other  ways  to  potentially  improve  schedule 
performance,  dating  back  to  reform  initiatives  from  the  1980s.  These 
include  some  of  the  approaches  mentioned  above,  in  addition  to 

acquiring  weapons  in  larger,  more  economical  quantities,  .  .  . 
[providing]  adequate  front-end  funding  for  test  hardware,  .  .  . 

[and]  having  enough  test  versions  of  the  weapon  to  permit  con¬ 
current  rather  than  sequential  testing  of  performance,  reliability, 
and  other  characteristics.  (GAO,  1986b,  pp.  5-6) 

There  are  specific  programs  that,  in  the  recent  past,  were  able  to 
rapidly  deliver  capabilities.  Perhaps  the  most  famous  and  largest  such 
program  is  the  MRAP.  This  program  successfully  fulfilled  an  urgent 
operational  need  (UON),  both  through  the  effective  employment  of 
many  of  the  strategies  discussed  in  this  chapter  and  through  a  unique  set 
of  circumstances,  including  rapid  access  to  large  amounts  of  budgetary 
resources  and  significant  senior  leadership  and  congressional  support. 
This  unique  set  of  circumstances  is  rare.  Thus,  while  the  MRAP  expe- 


2  For  instance,  there  may  be  negative  results  if  senior  leadership  is  pushing  to  field  a  pro- 
gram  for  which  the  technology  is  not  mature. 
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rience  provided  some  lessons  learned,  replicating  the  MRAP  approach 
on  more  typical  programs  may  not  be  feasible.  However,  it  is  a  good 
example  of  how  DoD  is  able  to  successfully  prioritize  schedule  above 
cost  and  many  aspects  of  technical  performance.3  A  detailed  case  study 
of  the  MRAP  program  is  presented  in  the  appendix. 

Table  3.1  provides  a  summary  of  ways  to  improve  schedules  that 
have  been  suggested  in  the  literature. 


Requirements  Development,  Generation,  and 
Management 

To  address  negative  schedule  effects  resulting  from  the  requirements 
process,  various  reports  promote  the  benefits  of  stable,  realistic  require¬ 
ments  while  recognizing  that  military  needs  change  over  time.  As  dis¬ 
cussed  in  Chapter  Two,  instability  in  requirements  is  strongly  related 
to  cost  and  schedule  growth  and,  thus,  should  be  avoided  as  much  as 
possible.  However,  maintaining  responsiveness  to  military  threats  may 
require  flexibility  in  requirements. 

The  Navy’s  Poseidon  P-8A  program — viewed  by  many  as  a 
success — illustrates  the  importance  of  feasible  and  stable  requirements. 
The  P-8A  stayed  on  schedule,  at  least  partially  because  of  stable  and 
technically  feasible  requirements  (e.g.,  through  an  emphasis  on  using 
proven  technologies),  the  use  of  a  commercial  derivative,  early  advanced 
development  efforts,  and  effective  program  management  (Blickstein 
et  ah,  2011,  p.  8). 

Farr,  Johnson,  and  Birmingham  (2005)  have  suggested  that  work¬ 
ing  closely  with  the  user  community  helps  to  manage  expectations 
as  a  means  to  maintain  program  schedules.  They  also  acknowledged 
that  requirements  must,  at  times,  evolve  and  be  flexible.4  According  to 
Brodfuehrer  (2000),  requirements  can  be  better  managed  by  working 


3  The  MRAP  is  unique  case,  but  the  cost  of  the  program  has  been  high  and  operations  and 
support  performance  very  low,  so  many  vehicles  are  now  being  scrapped  as  a  result. 

4  The  use  of  configuration  steering  boards  in  BBP  2.0,  promoted  primarily  for  their  afford¬ 
ability,  can  also  be  used  to  control  or  even  reduce  requirements  to  maintain  a  schedule. 
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Table  3.1 

Possible  Ways  to  Improve  Schedules  in  the  Acquisition  Literature 


Area 

Possible  Ways  to 
Improve  Schedules 

Analysis 

Current  Legislation 
and  Policy  (selected) 

Requirements 
development, 
generation,  and 
management 

Stable  and  realistic 
requirements 

GAO,  2010, 
p.  1;  Blickstein 
et  a  1 .,  2013; 
OUSD(AT&L), 
2013,  pp.  33-35 

* 

Collaboration 
between  the  program 
management  and  end- 
user  communities  (with 
proper  management) 

Brodfuehrer, 
2000,  pp.  22-27; 
Farr,  Johnson, 
and  Birmingham, 
2005 

Kendall,  2013 

Proper  management  of 
flexible  requirements 

Farr,  Johnson, 
and  Birmingham, 
2005 

Kendall,  2013 

Managing 
technological 
risk  in 

development 
and  production 

Use  of  mature/ 
demonstrated 
technology  to  ensure  a 
high  level  of  maturity 
before  production 

GAO,  2010, 
p.  1;  DSB, 

2009b;  GAO, 

1999,  pp.  3-4; 
GAO,  2010, 
p.  1;  Drezner  et 
al„  2011;  DoD, 
2001,  p.  49; 
OUSD(AT&L), 
2013,  pp.  33-35 

Kendall,  2013 

Use  of  incremental 
fielding  or  EA 
strategies  and  the 
development  of 
derivative  products 
(rather  than  brand-new 
designs) 

GAO,  2010,  p.  1; 
Johnson,  1999; 
Brodfuehrer, 

2000 

Interim  DoDI  5000.02, 
2013 

Employment  of  "agile" 
methods  that  easily 
respond  to  changes  in 
software  development 

Lapham  et  a  1 

2010 

* 

Prototyping 

Tyson  et  al., 

DoDI  5000.02,  2008; 

1989;  Drezner  Weapon  Systems 
and  Huang,  2009  Acquisition  Reform 

Act  of  2009  (WSARA) 
(Pub.  L.  111-23,  2009) 
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Table  3.1 — continued 


Area 

Possible  Ways  to 
Improve  Schedules 

Analysis 

Current  Legislation 
and  Policy  (selected) 

Managing 
technological 
risk  in 

development 
and  production 
(continued) 

Concurrency  in 
programs  with  low 
technological  risk 

Howitz,  2008, 
pp.  32-33; 

Kendall,  2012b; 
GAO,  2012a, 
p.  52;  Younossi 
et  a  1 .,  2005,  p.  56 

Kendall,  2012b 

Use  of  commercially 
derived  items 

DoD,  2001,  p.  49 

DoDI  5000.02,  2008 

Use  of  the  commercial 
practice  of  fixing  the 
design  before  the 
production  contract 
award 

Comptroller 
General  of  the 
United  States, 
1979,  p.  6;  GAO, 
2009,  p.  1; 

Kendall,  2012b 

DoDI  5000.02,  2008; 
WSARA  (Pub.  L.  HI- 
23,  2009) 

Use  of  the  commercial 
practice  of  reducing 
the  design's  complexity 

Comptroller 
General  of  the 
United  States, 
1979,  p.  6 

DoDI  5000.02,  2008 

Resource 

allocation 

Stable  funding 

GAO,  2010, 
p.  1;  Kassing 
et  a  1 .,  2007; 
Johnson,  1999; 
OUSD(AT&L), 

2013,  pp.  33-35 

* 

Adequate  test  funds 
(hardware,  modeling 
and  simulation) 

GAO,  1986b,  p.  5; 
Farr,  Johnson, 
and  Birmingham, 
2005 

* 

Acquisition 
management: 
internal  to  the 
program 

Bypassing  competition 
(including  employing 
multiyear  or  sole- 
source  procurement 
strategies  in  the 
production  phase) 

Tyson  et  a  1 ., 

1989,  p.  VI 1-7; 
Gailey,  2002; 

Reig,  1995 

DoDI  5000.02,  2008; 
Carter,  2010b;  Kendall, 
2013 

Preplanned  product 
improvement 

GAO,  1986b,  p.  5 

DoDI  5000.02,  2008 
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Table  3.1 — continued 


Area 


Possible  Ways  to  Current  Legislation 

Improve  Schedules  Analysis  and  Policy  (selected) 


Acquisition 
management: 
internal  to 
the  program 
(continued) 

Acquisition  of  the 
same  number  of  units 
but  in  larger,  more 
economical  quantities 
in  the  production 
phase 

GAO,  1986b,  p.  5 

Carter,  2010a,  2010b 

Emphasis  and 
adherence  to  schedule 
as  a  program  priority 
(e.g.,  MRAP  program) 

Ward,  2006; 
Brodfuehrer, 

2000 

* 

Development  and 
maintenance  of 
a  comprehensive 
and  realistic  master 
schedule 

GAO,  2013,  pp. 

7,  21;  Anderson 
and  Upton,  2012, 
p.  36 

DoDI  5000.02,  2008 

Use  of  contracting 
vehicles  to  expedite 
contracting  process 
(existing  contracts, 
undefinitized  contracts 
in  low-rate  initial 
production  [LRIP],  sole- 
source  contracts) 

GAO,  2012c; 
Greenhouse, 

2000; 

OUSD(AT&L), 

2013,  pp.  33-35 

Carter,  2010a,  2010b; 
Kendall,  2013 

Operational  testing 
and  evaluation  (OT&E) 
results  available  before 
production  startup 

GAO,  1990,  p.  1 

DoDI  5000.02,  2008 

Use  of  modeling  and 
simulation  to  reduce 
the  risk  and  duration  of 
live  tests 

Fox  et  al.,  2004 

DoDI  5000.02,  2008 

Involvement  of  the 
test  community  in  all 
program  phases 

Farr,  Johnson, 
and  Birmingham, 
2005 

DoDI  5000.02,  2008 

Use  of  integrated 
product  teams 

DoD,  2001,  p.  49 

DoDI  5000.02,  2008 

Improved  program 
stability  in  general, 
including  funding  and 
requirements 

GAO,  1986b,  p.  5; 
OUSD(AT&L), 

2013,  pp.  33-35 

* 

Improving  Schedule  Performance  41 


Table  3.1 — continued 


Area 

Possible  Ways  to 
Improve  Schedules 

Analysis 

Current  Legislation 
and  Policy  (selected) 

Acquisition 

Realistic  schedule 

GAO,  2010,  p.  1; 

WSARA  (Pub.  L.  Ill- 

management: 
internal  to 
the  program 
(continued) 

estimates 

OUSD(AT&L), 
2013,  pp.  33-35 

23,  2009) 

Acquisition 
management: 
external  to  the 

Senior  leadership 
support 

GAO,  2010,  p.  1 

* 

program 

Program  identified  as  a 
priority 

GAO,  2010,  p.  1 

* 

*  Lack  of  an  entry  does  not  imply  that  these  techniques  are  not  being  employed.  The 
completed  cells  in  this  column  provide  references  to  selected  implementations  that 
were  identified  in  our  search. 


closely  with  the  end  user  early  in  the  development  process.  However,  he 
also  pointed  out  that  flexible  requirements  can  be  problematic.  If  the 
government  is  not  careful,  lack  of  specification  in  requirements  could 
lead  to  the  development  of  an  undesirable  product.  In  addition,  if  end- 
user  involvement  is  not  managed  properly,  the  requirements  develop¬ 
ment  process  may  yield  an  unwieldy  set  of  requirements. 


Resource  Allocation 

As  summarized  in  Chapter  Two,  unstable  or  inadequate  funding  may 
result  in  longer  schedules  (Kassing  et  ah,  2007;  Drezner  and  Smith, 
1990).  Understandably,  then,  experts  have  suggested  maintaining  the 
stability  and  adequacy  of  funds  as  part  of  the  recipe  for  improving 
program  schedule  performance  (Johnson,  1999).  A  study  investigat¬ 
ing  successful  approaches  to  rapid  acquisition  identified  early  access  to 
adequate  funding  as  necessary  to  support  the  development  of  an  acqui¬ 
sition  strategy,  test  and  evaluation  strategy,  and  other  programmatic 
documentation  that  speeds  execution  (GAO,  2012c).  John  C.  Wilson, 
former  director  of  system  acquisition  in  what  is  now  OUSD(AT&L), 
asserted  that  program  managers  should  “advocate  and  seek  as  fully  and 
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completely  as  possible  the  funding  that  will  allow  a  program  to  be 
quickly  and  efficiently  executed”  (quoted  in  Johnson,  1999,  p.  11). 

The  literature  offers  few  proven  strategies  for  improving  program 
funding  stability  and  adequacy.  One  possibility  is  advanced  appropria¬ 
tions  (Blickstein  and  Smith,  2002), 5  but  its  limited  flexibility  for  man¬ 
agement  and  Congress  to  respond  to  unplanned  events  makes  it  dif¬ 
ficult  to  achieve.  Thus,  it  is  unclear  whether  advanced  appropriations 
will  become  widespread. 

Former  MRAP  program  manager  Thomas  Miller  (2010)  believes 
that  lessons  learned  from  the  MRAP  experience  can  be  applied  to  more 
typical  acquisition  programs  to  lessen  the  effects  of  funding  instability 
on  individual  programs.  First,  decisionmakers  should  keep  program 
managers  informed  of  potential  funding  cuts.  Second,  decisionmakers 
should  consider  cutting  low-value  programs  (a  portfolio  view)  rather 
than  spreading  cuts  across  all  programs  (the  latter  tactic  is  often  known 
as  a  “peanut  butter  spread”  or  “salami-slice”  approach).  Of  course,  these 
changes  will  not  make  funding  stable  for  low-priority  programs,  and 
advanced  notice  of  potential  cuts  may  not  make  much  difference  if  few 
hedging  options  are  available. 


Managing  Technical  Risk  in  Development  and  Production 

The  studies  that  have  focused  exclusively  on  schedule  growth  in 
weapon  system  programs  have  identified  technical  difficulties  as 
having  the  most  profound  impact  on  program  length.  For  example, 
in  2005,  the  Defense  Acquisition  Review  Journal  published  a  literature 
review  of  nearly  a  dozen  studies  describing  sources  of  schedule  slippage 
(see  Monaco  and  White,  2005).  The  most  commonly  cited  source  of 
schedule  slippage  was  technical  in  nature.  Drezner  and  Smith  (1990) 
and  Cashman  (1995)  also  identified  technical  difficulties  as  having  the 
most  profound  impact  on  program  length. 


’  Under  advanced  appropriations,  funds  are  not  appropriated  for  a  single  year  but  instead 
are  distributed  over  multiple  years  and  available  in  each  of  the  following  years. 
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The  literature  identifies  many  strategies  for  mitigating  technical 
risk.  We  present  selected  highlights  in  the  sections  that  follow. 

Starting  with  Mature  Technology  and  Design 

Many  reports  have  suggested  that  starting  with  mature  technology  will 
help  minimize  the  likelihood  of  schedule  problems  (GAO,  1999,  p.  5; 
GAO,  2010,  p.  1).  There  are  many  examples  of  streamlined  or  expe¬ 
dited  acquisition  processes  that  were  enabled  by  the  use  of  mature  tech¬ 
nologies  or  commercially  available,  nondevelopmental  items.  A  U.S. 
Army  Audit  Agency  report  (2011)  described  how  this  approach  resulted 
in  many  programs  entering  the  acquisition  process  at  Milestone  C,6 
streamlining  or  bypassing  many  of  the  earlier  acquisition  requirements, 
but  noted  delays  resulting  from  a  lack  of  additional  tailoring  and  staff¬ 
ing  of  capability  documents.  In  an  earlier  report  reviewing  TRLs  as 
applied  to  23  technologies,7  GAO  concluded  that  those  programs  with 
a  higher  level  of  technical  maturity  before  incorporating  new  technol¬ 
ogy  were  in  a  better  position  to  succeed  (GAO,  1999,  pp.  3-4).  Accord¬ 
ing  to  the  same  report,  “Programs  with  key  technologies  at  readiness 
levels  6  to  8  at  the  time  of  program  launch  met  or  were  meeting  cost, 
schedule,  and  performance  requirements”  (GAO,  1999,  p.  4).  In  recent 
testimony,  Kendall  (2012b)  mentioned  that  TRLs  are  useful  but  often 
not  sufficient  for  understanding  technology  risk.  Chittenden  has  sug¬ 
gested  that  ensuring  that  program  technology  “is  mature  enough  to 
realize  fielding  within  five  years  of  the  program’s  Milestone  A  decision” 
is  one  way  to  alleviate  the  concerns  associated  with  weapon  system 
complexity  and  schedule  duration  (Chittenden,  2012,  p.  103). 

Appropriate  knowledge  of  the  state  of  the  technology,  design,  and 
manufacturing  process  is  also  said  to  influence  program  success.  In  a 
2009  study,  GAO  identified  programs  that  it  claimed  proceeded  with 
insufficient  knowledge,  noting,  “For  47  programs  GAO  assessed  in- 
depth,  the  amount  of  knowledge  that  programs  attained  by  key  deci- 


6  Acquisition  programs  typically  enter  the  acquisition  process  at  Milestone  A  (design)  or 
Milestone  B  (development)  rather  than  Milestone  C  (production). 

7  A  TRL  is  a  DoD  measure  used  to  assess  the  maturity  of  evolving  technologies  during 
development. 
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sion  points  has  increased  in  recent  years;  but  most  programs  still  pro¬ 
ceed  with  far  less  technology,  design,  and  manufacturing  knowledge 
than  best  practices  suggest  and  face  a  higher  risk  of  cost  increases  and 
schedule  delays”  (GAO,  2009,  p.  1). 

In  addition  to  ensuring  sufficient  maturity  in  technology,  pro¬ 
ceeding  with  a  mature  design  may  improve  schedule  performance.  In 
an  older  report,  the  Comptroller  General  of  the  United  States  cited  a 
practice  in  the  commercial  sector  that  prevented  schedule  growth:  “The 
commercial  practice  of  fixing  the  design  before  contract  award,  along 
with  less  complexity  involved  with  the  design,  has  contributed  greatly 
to  the  commercial  sector’s  success  at  holding  down  cost  and  sched¬ 
ule  overruns”  (Comptroller  General  of  the  United  States,  1979,  p.  6). 
Of  course,  there  are  multiple  contract  award  points  in  defense  acquisi¬ 
tion,  but  current  practices  recognize  the  importance  of  completing  the 
preliminary  design  review  before  Milestone  B  (DoDI  5000.02,  2008; 
Pub.  L.  111-23,  2009).  The  prior  discussion  of  concurrency  addressed 
the  trade-offs  in  starting  production  before  designs  are  complete  (see, 
for  example,  Kendall,  2012b). 

Incrementally  Fielded  or  Evolutionary  Acquisition 

Incremental  fielding  and  EA  are  acquisition  strategies  that  have  been 
employed  as  a  way  to  speed  fielding  and  control  technical  risks.  They 
aim  to  provide  some  initial  operationally  useful  capabilities  more 
quickly  than  processes  that  use  a  single  step  to  acquire  a  capability.  EA 
achieves  this  goal  through  incremental  improvements,  which  are  less 
demanding  than  those  typically  seen  through  the  traditional  process. 

For  example,  current  DoD  acquisition  policy  designates  incre¬ 
mental  fielding  of  software-intensive  programs  as  one  possible  approach 
to  consider: 

Incrementally  Fielded  Software  Intensive  Program  ...  is  a  model 
that  has  been  adopted  for  many  DBS  [Defense  Business  Systems]. 

It  also  applies  to  upgrades  to  some  command  and  control  systems 
or  weapons  systems  software  where  fielding  will  occur  in  multiple 
increments  as  new  capability  is  developed  and  delivered,  nomi¬ 
nally  in  1-  to  2-year  cycles. 


Improving  Schedule  Performance  45 


This  model  is  distinguished  from  the  previous  model  by  the  rapid 
delivery  of  capability  through  several  limited  fieldings  in  lieu  of 
single  Milestones  B  and  C  and  a  single  full  deployment.  Each 
limited  fielding  results  from  a  specific  build,  and  provides  the  user 
with  mature  and  tested  sub-elements  of  the  overall  capability. 
Several  builds  and  fieldings  will  typically  be  necessary  to  satisfy 
approved  requirements  for  an  increment  of  capability.  The  iden¬ 
tification  and  development  of  technical  solutions  necessary  for 
follow-on  capabilities  have  some  degree  of  concurrency,  allowing 
subsequent  increments  to  be  initiated  and  executed  more  rapidly. 

This  model  will  apply  in  cases  where  commercial  off-the-shelf  soft¬ 
ware,  such  as  commercial  business  systems  with  multiple  modular 
capabilities,  are  acquired  and  adapted  for  DoD  applications.  An 
important  caution  in  using  this  model  is  that  it  can  be  structured 
so  that  the  program  is  overwhelmed  with  frequent  milestone  or 
fielding  decision  points  and  associated  approval  reviews.  To  avoid 
this,  multiple  activities  or  build  phases  may  be  approved  at  any 
given  milestone  or  decision  point,  subject  to  adequate  planning, 
well-defined  exit  criteria,  and  demonstrated  progress.  An  early  deci¬ 
sion  to  select  the  content  for  each  follow-on  increment  (2  through 
N)  will  permit  initiation  of  activity  associated  with  those  incre¬ 
ments.  Several  increments  will  typically  be  necessary  to  achieve  the 
required  capability.  (Interim  DoDI  5000.02,  2013,  p.  11) 

According  to  some  published  EA  best  practices: 

Think  “parallel  developments:”  Often  in  an  evolutionary  model, 
development  of  increments  must  occur  in  parallel  to  deliver  capa¬ 
bility  on  time.  Increments  may  vary  in  time  to  develop  and  inte¬ 
grate.  If  done  serially,  they  can  extend  the  program  schedule  and 
adversely  impact  the  ability  to  deliver  capability  to  the  users  in 
a  timely  manner,  which  was  the  purpose  of  evolutionary  acqui¬ 
sition.  Managing  parallel  development  is  challenging  but  not 
unachievable;  it  should  not  be  avoided.  Make  use  of  configura¬ 
tion  management  to  control  the  development  baselines  and  track 
changes.  Allow  time  in  the  increment  development  schedules  for 
the  reintegration  of  a  “gold”  baseline  for  final  incorporation  of 
parallel  changes  prior  to  test  and  fielding.  (MITRE,  2012) 
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Prototyping  and  Testing 

Prototyping  can  help  mature  the  technology  being  employed,  and  test¬ 
ing  can  measure  the  performance  and  determine  the  level  of  remaining 
risks.  These  approaches  reportedly  carry  schedule  implications  as  well. 

The  relationship  between  prototyping  and  schedule  reported 
in  the  literature  is  varied.  In  an  older  evaluation  of  cost  and  sched¬ 
ule  growth  of  programs  that  have  involved  prototypes,  Tyson  et  al. 
(1991)  concluded  that  prototyped  programs  help  predict  development 
costs,  but  these  programs  were  somewhat  longer  in  duration  than  those 
that  did  not  involve  prototyping.  The  authors  did  not  identify  the  rea¬ 
sons  why  these  programs  took  longer,  but  they  hypothesized  that  the 
increased  length  may  have  been  due  to  the  technical  complexity  of  the 
programs  studied. 

OT&E  activities  have  also  been  identified  as  an  area  that  may  yield 
schedule  improvements.  A  GAO  report  from  the  1980s  described  two 
initiatives  of  the  then-Deputy  Secretary  of  Defense  to  reduce  acquisi¬ 
tion  timelines  and  mitigate  schedule  slippage,  including  “emphasizing 
preplanned  product  improvement  and  obtaining  adequate  funding  for 
test  hardware”  (GAO,  1986b,  p.  5).  This  latter  recommendation  was  in 
response  to  a  previous  GAO  report  concluding  “that  test  schedules  of 
weapon  systems  were  constrained,  in  part,  by  too  few  prototypes  avail¬ 
able  for  testing.  As  a  result,  expensive  retrofits  were  required  to  correct 
problems  identified  during  operational  testing  performed  after  the  pro¬ 
duction  decision  was  made”  (GAO,  1986b,  p.  6). 

GAO’s  review  of  33  acquisition  improvement  initiatives  reported 
on  the  importance  of  meeting  performance  requirements  “in  a  repre¬ 
sentative  operational  environment”  prior  to  beginning  production.  The 
GAO  determined  that  many  of  the  major  systems  reviewed  did  not 
follow  this  best  practice  and,  as  a  result,  they  required  expensive  retro¬ 
fits  following  operational  testing.  The  experience  of  the  Sergeant  York 
program  is  an  extreme  example.  The  program  “was  canceled  after  64 
systems  costing  $1.8  billion  had  been  produced  and  delivered  because, 
according  to  the  Secretary  of  Defense,  independent  operational  tests 
showed  that  the  system’s  performance  did  not  meet  the  military 
threat”  (GAO,  1986d,  p.  29).  In  another  report,  GAO  also  claimed 
that  “making  OT&E  results  available  before  production  start-up  could 
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help  preclude  cost  growth,  schedule  slippages,  and  performance  short¬ 
falls  that  frequently  arise  during  the  later  phases  of  a  weapon  system’s 
development”  (GAO,  1990,  p.  1). 

The  literature  identifies  potential  improvements  to  testing  pro¬ 
cesses  and  procedures.  Bernard  Fox  and  colleagues  (2004)  suggested 
that  the  use  of  integrated  contractor-government  test  teams  and  a 
reevaluation  of  test  procedures  could  optimize  testing.  This  same 
report  (p.  xxi),  along  with  Farr,  Johnson,  and  Birmingham  (2005), 
described  modeling  and  simulation  as  techniques  that  can  reduce  risk 
and  duration  of  tests.  Farr,  Johnson,  and  Birmingham  also  found  that 
the  test  community  may  delay  fielding  until  a  100-percent  solution  is 
achieved,  concluding  that  involving  the  test  community  in  all  phases 
of  a  program  would  help  maintain  schedules  by  ensuring  that  issues  are 
uncovered  as  soon  as  possible.  However,  Fox  and  colleagues  point  out 
that  staffing  limitations  may  preclude  early  integration  of  testing  and 
evaluation  personnel  (B.  Fox  et  ah,  2004,  p.  xxi). 

Development  and  Manufacturing  Approaches 

As  discussed  earlier,  concurrency  has  been  identified  as  a  possible 
means  for  reducing  program  cycle  time.  If  technical  risk  is  low  and 
concurrency  is  managed  and  executed  properly,  concurrency  can  result 
in  reduced  schedules.  If  technical  risk  is  too  great  or  not  managed  and 
executed  properly,  then  concurrency  can  lead  to  significant  cost  and 
schedule  growth.  The  MRAP  program,  for  example,  employed  proven, 
mature,  and  commercially  available  technologies  and  was  therefore 
successful  in  implementing  concurrency  (see  the  appendix).  Moreover, 
the  question  is  how  much  concurrency  is  the  right  mix  of  technical, 
cost,  schedule,  and  operational  capability  risk  (see,  for  example,  Ken¬ 
dall,  2012b). 

The  literature  cites  a  host  of  development  and  manufacturing 
approaches  that  may  improve  schedule  performance.  Many  of  these 
approaches  are  found  in  the  software  development  world.  For  exam- 
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pie,  agile  architectures* 1 2 3 4 5 6 7 8  and  service-oriented  architectures9  are  cited  as 
approaches  that  can  help  improve  schedule  performance  for  software 
development  activities.  In  a  2009  study,  the  Software  Engineering 
Institute  at  Carnegie  Mellon  University  published  a  report  suggesting 
that,  while  some  challenges  must  be  overcome,  DoD  could  employ 
agile  methods  to  procure  software.10  Proponents  of  agile  architectures 
argue  that  this  development  approach  delivers  software  capability  more 
quickly.  In  a  2009  briefing  on  reducing  the  acquisition  cycle  time  in 
technology  insertion,  Bliss  discusses  broader  agile  approaches,  stating, 
“Structuring  the  DoD  enterprise  for  agility  in  responding  to  rapidly 
developing  and  constantly  changing  environment  is  ...  At  least  as 
important  as  investing  [in]  new  technology”  (Bliss,  2009,  slide  15).  In 
addition  to  concurrency  and  agile  acquisition,  inserting  “commercial 
parts  and  technology  in  weapon  systems”  (Lorell  and  Graser,  2001, 
p.  xxiii)  and  implementing  lean  manufacturing  or  competitive  man¬ 
ufacturing  have  also  been  identified  as  potentially  effective  ways  to 
reduce  schedules  (see,  for  example,  Neves  and  Strauss,  2008,  p.  22). 


8  According  to  Yakyma  and  Leffingwell  (2013),  the  “Seven  Principles  of  Agile  Architec- 
ture”  are  as  follows: 

1.  Design  emerges.  Architecture  is  a  collaboration. 

2.  The  bigger  the  system,  the  longer  the  runway. 

3.  Build  the  simplest  architecture  that  can  possibly  work. 

4.  When  in  doubt,  code,  or  model  it  out. 

5.  They  build  it,  they  test  it. 

6.  There  is  no  monopoly  on  innovation. 

7.  Implement  architectural  flow. 

9  According  to  IBM,  service-oriented  architecture  has  the  following  characteristics:  It 

enhances  the  relationship  between  enterprise  architecture  and  the  business,  it  allows  devel¬ 
opers  to  build  composite  applications  as  a  set  of  integrated  services,  and  it  provides  flexible 
business  processes  (Portier,  2007). 

10  Agile  is  a  philosophical  development  approach.  For  more  information,  see  Lapham  et  ah, 
2010. 
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Defense  Acquisition  Management:  Practices,  Policies,  and 
Procedures 

DoD’s  Guide  to  the  Project  Management  Body  of  Knowledge  has  recom¬ 
mended  the  use  of  “realistic  cost  estimates  and  fully  funding  those 
estimates”  as  a  best  practice  (DoD,  2003).  This  is  also  a  requirement  for 
Milestone  B  certification:  “[Reasonable  cost  and  schedule  estimates 
have  been  developed  to  execute,  with  the  concurrence  of  the  Director 
of  Cost  Assessment  and  Program  Evaluation,  the  product  development 
and  production  plan  under  the  program”  (10  U.S.C.  §  2366b).  Incre¬ 
mental  fielding  is  one  possible  model  for  software-intensive  programs 
in  current  DoD  policy  (Interim  DoDI  5000.02,  2013).  Additionally, 
commercial  items  can,  in  some  cases,  have  further  benefits.  These  and 
other  acquisition  strategies  are  summarized  below. 

Program  Management:  Schedule  Estimation  and  Management 

Neves  and  Strauss  (2008,  p.  21)  have  asserted  that  adhering  to  an 
aggressive  schedule  requires  making  trade-offs: 

All  programs  have  a  measure  of  schedule  pressure.  Once  base¬ 
lined,  the  ‘iron  triangle’  of  cost,  schedule,  and  technical  scope  is 
at  play.  But  truly  schedule- driven  development  programs  behave 
differently  and  have  different  needs.  Attempting  to  plan,  execute, 
and  manage  a  truly  schedule-driven  development  effort  as  if  it 
were  a  standard  acquisition  program  done  faster  will  not  work, 
will  slip,  will  cost  more — and  will  probably  get  you  fired. 

For  example,  GAO  questioned  how  MRAPs  would  fit  into  the 
services’  long-term  plans,  suggesting  that  the  services  dispensed  with 
the  typical  discussions  regarding  the  long-term  utility  of  the  vehicle 
in  the  interest  of  delivering  the  capability  as  quickly  as  possible  (Sul¬ 
livan,  2009).  Reliability,  mobility,  and  safety  challenges  surfaced  fol¬ 
lowing  deployment;  these  may  not  have  been  issues  if  the  program  had 
been  given  more  time  to  plan,  develop,  and  produce  a  better-engineered 
vehicle  (Sullivan,  2009).  Additionally,  and  perhaps  most  importantly, 
because  of  immediate  wartime  needs,  decisionmakers  prioritized  the 
MRAP’s  schedule  above  potential  technical  improvements,  and  the  user 
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community  was  “willing  to  accept  a  useful  solution  in  the  short  term 
while  the  program  management  office  continued  to  develop  the  system 
to  its  desired  end-state”  to  deploy  a  basic  capability  as  quickly  as  possible 
(Blakeman,  Gibbs,  and  Jeyasingam,  2008,  p.  19).  In  another  example, 
the  F/A-18E/F  program  was  able  to  control  cost  and  schedule  growth 
by  limiting  performance  requirements  more  effectively  than  other  pro¬ 
grams.  While  the  F/A-18E/F  provided  “some  incremental  improve¬ 
ments  over  the  C/D  model,  especially  in  the  areas  of  stealth,  range, 
and  payload  capacity  .  .  .  the  [program]  sought  lower  performance  in 
some  areas  compared  with  the  F-14”  (Younossi  et  ah,  2005,  pp.  4-5).  A 
major  issue  for  program  management  is  whether  “revolutionary”  capa¬ 
bilities  and  technologies  are  needed  to  meet  the  threat.  Revolutionary 
new  technologies  and  capabilities  will  involve  inherently  risky  develop¬ 
ment  programs.  A  key  question  is  how  development  programs  seeking 
revolutionary  breakthroughs  can  best  be  managed. 

Other  analysts  have  suggested  that  schedules  may  be  improved 
through  increased  management  prioritization  and  schedule  oversight. 
Ward  and  Quaid  (2006)  recommended  setting  aggressive  schedule 
improvement  goals  for  all  DoD  programs  and  tracking  their  schedule 
performance  with  cycle-time  metrics.  They  also  suggested  introduc¬ 
ing  schedule  incentives  into  more  DoD  contracts.  Brodfuehrer  (2000) 
emphasized  tracking  progress  and  sustaining  urgency. 

The  literature  also  highlights  the  importance  of  personnel  qual¬ 
ity  and  effective  communication  in  managing  schedules.  According 
to  Brodfuehrer  (2000),  ensuring  that  the  program  has  the  right  staff 
and  that  there  is  a  good  understanding  of  how  the  system  will  evolve 
over  time  could  minimize  disruptions  caused  by  upgrades,  changing 
technology,  or  new  requirements.  Farr,  Johnson,  and  Birmingham 
(2005)  have  emphasized  the  importance  of  good  and  continuous  com¬ 
munication  among  members  of  the  development  team  to  maintain 
the  schedule,  including  the  program  manager,  contractor,  and  govern¬ 
ment  staff.  Anderson  and  Upton  (2012)  have  promoted  the  use  of  an 
IMS  to  manage  and  control  schedule,  rather  than  simply  treating  it  as 
an  unused  oversight  document.  Specifically,  “there  is  a  colossal  gap  in 
available  resources  skilled  in  the  management  and  use  of  the  IMS.  All 
these  factors  drive  the  underutilization  of  the  IMS,  which  plays  a  large 
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part  in  the  plague  of  program  cost  overruns  and  late  deliveries”  (Ander¬ 
son  and  Upton,  2012,  p.  36). 

Acquisition  Approach 

Contractor  Incentives  and  the  Contracting  Process 

Providing  the  right  incentives  could  help  to  improve  contractor  sched¬ 
ule  performance  (Schinasi,  2008,  p.  2).  In  an  evaluation  of  shipbuild¬ 
ing  in  the  United  Kingdom,  Arena  et  al.  (2005)  reported  that  commer¬ 
cial  contracts  employed  more  incentives  for  on-time  delivery  than  their 
military  counterparts  during  their  review  period,  and  these  incentives 
contributed  to  better  on-time  performance.  DAU  currently  provides 
guidance  on  using  incentives  with  schedule  goals: 

•  When  assigning  a  proht/fee  value  for  technical  risk,  consider 
“above  normal  value”  when  “[t]he  contractor  has  accepted  and 
accelerated  delivery  schedule  to  meet  DoD  requirements” 
(OUSD[AT&L],  2012). 

•  In  contracts,  incentives  can  be  used  to  motivate  schedule  or  deliv¬ 
ery,  along  with  performance  and  cost  incentives  (OUSD[AT&L], 
2012). 

As  discussed  in  Chapter  Two,  competition  may  induce  addi¬ 
tional  incentives,  but  its  ability  to  reduce  cycle  times  is  unclear.  In 
fact,  the  majority  of  the  literature  on  the  relationship  between  contract 
strategies  and  schedule  supports  sole-source  and  multiyear  procure¬ 
ment  as  the  most  schedule-friendly  approaches.11  For  example,  Tyson 
and  colleagues  reported  that  competition  led  to  longer  programs, 
while  multiyear  and  sole-source  procurements  led  to  reduced  program 
lengths  (Tyson  et  ah,  1989,  p.  VII-7).  Moore  and  colleagues  (2012) 
identified  sole-source  contracts  as  providing  a  quicker  way  to  satisfy  an 
urgent  customer  requirement.  In  an  assessment  of  the  F-22  program, 
Yonoussi  et  al.  (2007,  p.  xv)  found  benefits  in  multiyear  procurement, 
such  as  the  ability  to  “schedule  workers  and  facilities  more  efficiently 


Sole-source  contracting  is  subject  to  various  laws  and  regulations,  which  must  be  taken 


into  account. 


52  Prolonged  Cycle  Times  and  Schedule  Growth  in  Defense  Acquisition 


and  reduce  the  burden  of  preparing  multiple  proposals,”  which  could, 
in  turn,  yield  schedule  improvements. 

Neves  and  Strauss  (2008)  warned  that  objective  award  fees  based 
on  delivery  dates  can  prioritize  schedule  performance  at  the  expense 
of  other  factors,  increasing  the  probability  of  on-time  delivery  but  also 
risking  compromised  technical  and  cost  discipline.  They  advised  using 
multiple  balanced  incentives  to  avoid  incentivizing  such  undesirable 
side  effects.  Neves  and  Strauss  also  suggested  developing  a  risk  plan  to 
explicitly  manage  competing  objectives,  offering  the  following  advice 
to  program  managers: 

Push  your  contractor — and  yourself — to  actually  develop  the 
risks  and  their  mitigation  plans.  .  .  .  Risk  plans  that  merely  exist 
in  presentation  material  and  have  not  been  developed  so  that 
schedule,  performance,  and  cost  impacts  are  known  in  terms  of 
the  program  integrated  master  schedule,  system  specification,  test 
plans,  and  development  capacity  are  worse  than  having  no  risk 
management  at  all.  (Neves  and  Strauss,  2008,  p.  23) 

Many  sources  have  identified  undefinitized  contracts  as  an 
additional  technique  to  make  progress  while  the  contracting  process 
is  finalized,  ffowever,  according  to  OUSD(AT&L)  (2013,  p.  54), 
“Undefinitized  contract  actions  (UCAs)  had  a  measurable  increase 
on  total  contract  cost  growth  and  also  on  cycle  time  in  development” 
on  MDAP  contracts  from  1970  to  2011.  Interestingly,  the  office  also 
reported  that  “UCAs  did  not  correlate  with  total  cost  growth  in  early 
production  as  they  did  on  development  contracts”  (p.  62).  This  seems 
to  indicate  that  UCAs  may  be  successfully  employed  in  early  produc¬ 
tion  to  help  maintain  schedules,  and  that  UCAs  may  not  be  appropri¬ 
ate  in  all  parts  of  the  acquisition  process. 

Another  contracting  option,  indefinite-delivery/indefinite-quan¬ 
tity  (IDIQ)  contracts,  might  also  streamline  schedules.  This  recom¬ 
mendation  mainly  applies  to  the  production  phase  and  lower-tier  parts 
and  component  suppliers.  According  to  the  General  Services  Admin¬ 
istration,  IDIQ  arrangements  “help  streamline  the  contract  process 
and  speed  service  delivery”  (Thompson,  2013).  Greenhouse  describes 
other  benefits  of  IDIQ  contracts,  including  flexibility  in  stated  limits, 
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increased  contracting  efficiency,  lower  contracting  costs,  and  lower 
proposal  costs  (Greenhouse,  2000,  p.  18). 

Tailoring  the  Acquisition  Process 

As  discussed  in  Chapter  Two,  the  DoD  5000-series  guidance  docu¬ 
ments  allow  programs  to  tailor  the  acquisition  process  and  require¬ 
ments  documentation;  however,  for  multiple  reasons,  program  manag¬ 
ers  are  often  reluctant  to  take  advantage  of  tailoring  options.12  In  the 
latest  guidance  recently  released,  tailoring  is  given  greater  focus: 

The  structure  of  a  DoD  acquisition  program  and  the  procedures 
used  should  be  tailored  as  much  as  possible  to  the  characteristics 
of  the  product  being  acquired,  and  to  the  totality  of  circumstances 
associated  with  the  program  including  operational  urgency  and 
risk  factors.  (Interim  DoDI  5000.02,  2013) 

Weapon  system  programs  have  received  waivers  when  it  comes  to 
many  of  the  requirements  dictated  by  the  Defense  Acquisition  System. 
As  a  pilot  program,  the  Joint  Direct  Attack  Munition  program  imple¬ 
mented  provisions  of  the  Federal  Acquisition  Streamlining  Act,  which 
allowed  the  program  “to  use  commercial  item  exemptions  for  noncom¬ 
mercial  items”  (Myers,  2002,  p.  316).  These  waivers  and  exemptions 
streamlined  the  program’s  review  processes  and  reporting  procedures, 
contributing  to  the  on-time  delivery  of  munitions  (Myers,  2002). 

Rapid  Acquisition  and  Urgent  Operational  Needs 

The  majority  of  the  reviewed  literature  describing  schedule  growth 
and  improvement  refers  to  schedule  growth  observed  in  “traditional” 
acquisition  programs.  By  contrast,  DoD  also  procures  materials  for 
UONs  or  joint  urgent  operational  needs  (JUONs).  These  programs  are 
a  high  priority  and  involve  capabilities  that  must  be  delivered  to  the 
warfighter  quickly.  Lessons  learned  from  UON  and  JUON  acquisi¬ 
tion  programs  can  help  illuminate  the  challenges  that  DoD  faces  with 
rapid  acquisition  or  accelerated  schedules.  A  Defense  Science  Board 


12  The  Defense  Acquisition  Guidebook,  in  particular,  emphasizes  the  tailoring  of  processes 
and  documentation  (see  DAU,  2013). 
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task  force  reported  in  July  2009  that  DoD  “lacks  the  ability  to  rapidly 
held  new  capabilities  for  the  warfighter  in  a  systematic  and  effective 
way”  (DSB,  2009b,  p.  vii).  The  task  force  recommended  establishing  a 
process  to  determine  which  programs  needed  a  rapid  acquisition  pro¬ 
cess  and  developing  a  unique  process  to  efficiently  and  effectively  sat¬ 
isfy  these  urgent  needs.  The  task  force  suggested  establishing  a  new 
agency  to  implement  this  rapid  process  and  that  the  executive  and 
legislative  branches  should  establish  a  separate  funding  stream  to  sat¬ 
isfy  urgent  needs.  Finally,  it  emphasized  that  “any  rapid  response  must 
be  based  on  proven  technology  and  robust  manufacturing  processes,” 
underscoring  the  importance  of  proven,  mature  technology  and  pro¬ 
cesses,  regardless  of  the  unique  privileges  afforded  to  a  program  (DSB, 
2009b,  p.  ix).  As  a  result  of  this  concern,  the  Joint  Rapid  Action  Cell 
was  established  within  OUSD(AT&L)  and  is  responsible  to  the  Secre¬ 
tary  of  Defense  through  the  USD(AT&L)  and  USD(Comptroller).  It 
monitors,  coordinates,  and  facilitates  meeting  combatant  commanders’ 
urgent  warfighting  needs  (DAU,  2008). 

A  recent  GAO  report  (2012c)  stated  that  some  of  the  challenges 
identified  with  rapid  acquisition  programs  involve  the  lengthy  process 
of  getting  a  contract  awarded.  Among  the  initiatives  that  GAO  stud¬ 
ied,  those  that  were  successful  used  existing  contracts,  undehnitized 
contracts,  sole-source  contracts,  and  other  tools  to  help  expedite  con¬ 
tracting.  Off-the-shelf  initiatives  took  longer  than  other  initiatives  to 
get  on  contract  because  they  did  not  have  the  option  of  leveraging 
existing  contracts.  However,  they  were  able  to  held  capabilities  more 
quickly  once  their  contracts  were  awarded  (GAO,  2012c). 

The  MRAP  program  is  one  of  the  most  recent  successful  major 
programs  to  implement  rapid  acquisition.  The  program  was  able  to 
deliver  vehicles  at  a  significant  rate  less  than  two  years  after  its  incep¬ 
tion  (GAO,  2009).  Several  conditions  enabled  this  quick  production 
and  fielding,  including  high-level  leadership  support  and  a  special  high- 
priority  status  within  DoD,  which  facilitated  some  of  the  program’s 
nontraditional  acquisition  approaches.  The  program  also  utilized  cre¬ 
ative  contracting  strategies — including  undehnitized  contracts — and 
was  committed  to  the  use  of  proven  technologies.  A  detailed  case  study 
of  the  MRAP  program  is  provided  in  the  appendix. 


CHAPTER  FOUR 

Conclusions 


Given  the  continuing  interest  in  ensuring  that  acquisition  program 
cycle  times  and  schedule  growth  are  reasonable  and  minimized,  we 
reviewed  and  summarized  the  recent  and  historical  literature  on  the 
two  issues  involving  program  schedule:  schedule  slip  and  longer  pro¬ 
gram  schedules.  The  open-source  literature  includes  a  range  of  pro¬ 
gram  examples,  quantitative  and  qualitative  analysis,  expert  opinions, 
and  conceptual  assertions.  Our  review  did  not  attempt  to  judge  the 
strength  of  the  evidence  supporting  these  assertions  and  analyses  but, 
rather,  surveyed  as  broadly  as  possible  the  full  range  of  causes  put  for¬ 
ward  by  experts  in  the  held.  We  also  note  that  reports  may  reflect  dif¬ 
ferent  conditions  over  time  or  differences  between  sampled  programs. 
We  identified  the  following  reasons  for  schedule  delays  in  the  literature 
that  we  reviewed: 

•  The  reason  asserted  most  often  was  difficulty  managing  tech¬ 
nical  risk  (e.g.,  program  complexity,  immature  technology,  or 
unanticipated  technical  issues). 

•  The  second  most  common  reason  was  initial  assumptions  or 
expectations  that  were  difficult  to  fulfill  (e.g.,  schedule  esti¬ 
mates,  risk,  requirements,  or  performance  assumptions). 

•  Another  common  reason  was  funding  instability,  which  compli¬ 
cates  management  and  can  directly  stretch  production  schedules. 

Some  of  these  processes  and  activities  occur  outside  of  the  con¬ 
trol  of  program  management,  while  others  fall  under  its  control.  The 
literature  describing  sources  of  schedule  growth  tends  to  focus  on  nega- 
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five,  rather  than  positive,  program  examples.  Thus,  many  recommen¬ 
dations  for  schedule  improvement  in  the  literature  may  be  based  more 
on  avoiding  pitfalls  than  on  following  proven  paths  to  success. 

The  most  common  recommendations  to  reduce  cycle  time  and 
control  schedule  growth  are  strategies  for  better  managing  tech¬ 
nical  risk.  These  recommendations  include  using  incremental  field¬ 
ing  and  EA  strategies  and  developing  derivative  products  (rather  than 
brand-new  designs),  as  well  as  using  mature  or  proven  technology  (i.e., 
commercially  available  components).  Other  recommendations  for  mit¬ 
igating  issues  beyond  technical  risk  include  maintaining  stable  fund¬ 
ing,  using  atypical  contracting  vehicles,  and  making  the  schedule  a  top 
priority  (e.g.,  at  higher  expense  or  lower  technical  requirements).  Some 
strategies  identified  require  careful  consideration  of  program  charac¬ 
teristics  prior  to  program  initiation;  otherwise,  schedules  may  suffer  as 
a  result.  No  strategy  is  appropriate  in  every  case,  so  careful  judgment 
and  balancing  are  required.  For  instance,  prioritizing  the  schedule  may 
be  challenging  in  a  program  with  immature  technology  that  has  no 
options  for  incorporating  mature  technology. 

The  schedule  is  intrinsically  tied  to  a  large  set  of  broader  consider¬ 
ations  for  program  managers  and  other  stakeholders.  The  complexity  of 
these  relationships  makes  it  difficult  to  isolate  the  causes  of  prolonged 
cycle  times  and  schedule  growth.  It  also  makes  testing  mitigation  strat¬ 
egies  for  reducing  cycle  times  and  stemming  schedule  growth  prob¬ 
lematic.  However,  if  common  themes  in  the  literature  are  valid,  then 
progress  in  the  following  areas  may  yield  schedule  improvements: 

•  reducing  technological  risk 

•  providing  realistic  estimates  and  expectations 

•  ensuring  the  feasibility  and  stability  of  requirements. 

We  address  each  of  these  considerations  in  turn,  along  with  related 
drawbacks  and  potential  directions  for  future  research. 

Reducing  Technological  Risk 

If  the  schedule  is  to  be  prioritized  or  fixed  in  the  “iron  triangle”  of 
cost,  schedule,  and  technical  performance,  the  literature  asserts  that 
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managing  or  reducing  technical  risk  must  be  a  priority.  Not  one  source 
we  reviewed  claimed  that  costs  could  be  reasonably  adjusted  to  accom¬ 
modate  an  aggressive  schedule  in  a  program  with  a  given  set  of  per¬ 
formance  expectations.  Instead,  restrictions  on  performance  require¬ 
ments  and  technical  risk  have  been  repeatedly  emphasized  as  the  keys 
to  reducing  timelines  and  avoiding  schedule  slippage. 

One  of  the  most  important  aspects  of  technical  risk  is  the  matu¬ 
rity  of  the  technology  being  used  and  the  complexity  of  system  integra¬ 
tion.  Most  of  the  programs  highlighted  in  this  report  for  their  excel¬ 
lent  schedule  performance  (e.g.,  P-8A,  F/A-18E/F,  and  MRAP)  can  be 
reasonably  characterized  as  evolutionary,  lower- capability  systems  and 
employed  technologies  that  were  relatively  proven  and  in  use  either 
in  other  military  weapon  systems  or  in  the  commercial  sector.  Those 
programs  highlighted  for  their  poor  schedule  performance  (e.g.,  F-22 
and  the  Future  Combat  Systems)  are  revolutionary  systems  and  were 
much  more  ambitious  in  this  respect,  requiring  (among  other  things) 
the  development  and  integration  of  less  mature  technologies  or  new 
combinations  of  technologies.  While  “large  leaps”  in  technological 
advancement  are,  at  times,  desirable  and  even  obtainable,  the  literature 
clearly  warns  against  pursuing  these  leaps  under  a  tight  deadline.  In 
cases  where  revolutionary  systems  are  warranted,  managing  technical 
risk  would  be  a  priority  for  program  management. 

Because  it  uses  incremental  (rather  than  single-step)  technologi¬ 
cal  improvements,  incremental  fielding  is  cited  as  one  possible  model 
to  consider  for  software-intensive  programs  (Interim  DoDI  5000.02, 
2013).  Conceptually,  it  should  reduce  technical  risk  substantially  by 
incorporating  technologies  only  after  they  are  sufficiently  mature  or 
can  be  accommodated. 

Such  concerns  may  have  led  to  the  de-emphasis  on  EA  for  hard¬ 
ware-intensive  systems  since  the  prior  DoDI  5000.02  (2008).  Of 
course,  future  upgrades  to  systems  can  be  employed  to  insert  new  tech¬ 
nologies  into  systems. 

It  should  be  noted  here  that  while  incremental  fielding  should 
theoretically  reduce  technical  risk  and  improve  schedule  performance 
in  specific  programs,  these  improvements  do  not  necessarily  translate 
to  accelerated  deployment  of  all  desired  technologies  to  the  held.  Tech- 
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nology  must  be  developed  before  it  can  be  deployed,  and  incremental 
fielding  simply  recognizes  that  it  is  best  to  insert  technology  when  it  is 
ready  rather  than  forcing  it  to  be  ready  by  fiat.  Determining  the  matu¬ 
rity  and  operational  utility  of  new  technologies  prior  to  Milestone  B 
(when  a  full-fledged  program  is  established)  could  save  the  department 
time  and  money.  These  savings  could  be  achieved  not  necessarily  by 
reducing  time  and  money  spent  on  fielded  systems,  but  by  avoiding 
significant  investments  in  established  programs  based  on  technologies 
that  are  not  yet  ready  for  incorporation  in  a  system.  This  cost  avoid¬ 
ance  could,  in  turn,  free  up  funds  for  programs  that  employ  mature 
technologies  and  could  be  accelerated  if  they  had  more  resources. 
Unfortunately,  analysts  have  pointed  out  that  placing  restrictions  on 
performance  expectations  and  technology  insertion  in  acquisition 
programs — as  encouraged  under  an  EA  approach — can  run  counter  to 
the  military’s  desire  to  achieve  and  sustain  a  competitive  edge  over  its 
adversaries  (Arena  et  al.,  2006).  Current  processes  such  as  affordability 
constraints  and  Configuration  Steering  Boards  (Interim  DoDI,  2013; 
Kendall,  2013)  indicate  a  willingness  to  make  such  trades. 

The  answers  to  the  following  research  questions  would  help  quan¬ 
tify  the  problem  of  technical  risk  and  their  costs,  allowing  these  costs  to 
be  weighed  against  the  military’s  desire  for  faster  technology  advance¬ 
ment  and  deployment: 

•  How  much  time  and  money  has  been  spent  on  programs  that 
were  unachievable  from  the  start? 

•  How  many  programs  in  the  recent  past  have  been  canceled 
because  of  technology  immaturity? 

•  How  much  had  been  invested  in  these  programs  at  the  time  of 
cancellation? 

Improving  the  Accuracy  of  Schedule  Estimates  and  Expectations 

The  literature  implies  that  there  is  a  need  to  improve  schedule  estimates 
and  expectations.  “Overly  optimistic”  and  “ambitious”  are  two  phrases 
commonly  used  to  describe  the  estimates  and  expectations  included 
in  problematic  program  plans.  Overly  optimistic  schedule  estimates 
blind  decisionmakers  to  the  need  to  make  early,  informed  trade-offs, 
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and  they  set  up  programs  for  later  criticism  over  schedule  growth.  Cor¬ 
recting  inaccuracies  and  overcoming  the  pressures  associated  with  pro¬ 
gram  advocacy  (a  commonly  cited  source  of  these  inaccuracies)  is  diffi¬ 
cult.  Thus,  improved  schedule  estimates  could  help  improve  schedules. 
According  to  analysts  we  consulted,  schedule-estimating  methodolo¬ 
gies  are  not  as  well  developed  as  cost-estimating  methodologies.  The 
limited  prevalence  of  schedule  estimation  in  the  literature  supports  this 
observation. 

The  answers  to  the  following  related  research  questions  would 
help  quantify  the  scope  of  the  schedule-estimation  problem  and  offer 
guidance  for  improving  the  tradecraft  in  DoD: 

•  To  what  extent  are  schedule-estimating  skills  present  in  today’s 
acquisition  workforce? 

-  Where  are  these  skills  located?  Could  they  be  better  employed? 

-  How  might  these  skills  be  fostered? 

0  Is  better  training  needed? 

0  Should  the  department  seek  individuals  with  more  experi¬ 
ence  in  schedule  estimating? 

•  Are  program  managers  incentivized  to  unreasonably  adhere  to 
established  schedules?  If  not,  how  might  incentives  encourage 
better  schedule  performance? 

•  How  robust  are  the  schedule-estimating  methodologies  currently 
used  by  the  acquisition  workforce?  How  might  they  be  improved? 

•  How  does  the  commercial  sector  develop  and  implement  sched¬ 
ules  for  complex  high-technology  development  and  production 
programs?  How  good  is  the  record  in  the  commercial  sector  for 
such  estimates? 

Improving  the  Feasibility  and  Stability  of  Requirements 

The  literature  asserts  that  aggressive  and  rigid  adherence  to  overly 
ambitious  requirements  can  contribute  to  prolonged  acquisition  sched¬ 
ules  and  schedule  growth.  Additionally,  the  literature  describes  a  com¬ 
plicated  relationship  between  requirements  instability  and  schedule 
growth.  According  to  an  OUSD(AT&L)  report, 
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The  time  required  to  acquire  next-generation  capabilities  is  often 
longer  than  the  strategic  threat  and  technology  cycles  these 
capabilities  are  meant  to  address.  Performance  (good  or  bad)  in 
planned  defense  acquisition  is  intertwined  with  cost  and  sched¬ 
ule  implications  from  unplanned  responses  to  these  external 
demands.  This  is  not  an  excuse  for  cost  and  schedule  growth, 
but  an  observation  from  first  principles  that  changing  threats  and 
needs  can  add  costs  and  delays  relative  to  original  baselines  as 
ongoing  acquisitions  are  adjusted.  (OUSD[AT&L],  2013,  p.  109) 

However,  effective  communication  among  the  requirements, 
acquisition,  and  test  communities  has  been  highlighted  as  a  way  to 
avoid  unstable  or  infeasible  requirements  (Brodfuehrer,  2000;  Farr, 
Johnson,  and  Birmingham,  2005;  Kendall,  2013).  Adherence  to  a 
schedule  will  require  that  this  communication  be  focused  on  (1)  reduc¬ 
ing  (rather  than  expanding)  program  scope  whenever  possible  and  (2) 
allowing  flexibility  (rather  than  enforcing  stringency)  in  performance 
requirements.  This  flexibility,  at  times,  means  that  the  user  community 
needs  to  accept  a  less-than-perfect  solution  in  the  short  term,  with  the 
understanding  that  improvements  and  modifications  might  be  made 
later  on  if  they  are  viable  and  affordable. 

Research  centered  on  the  following  questions  may  help  DoD 
understand  where  improvements  in  this  area  are  needed: 

•  What  has  been  the  experience  of  technically  complex  programs 
with  respect  to  early  and  continuing  user  involvement  in  control¬ 
ling  and  adjusting  requirements? 

-  What  is  the  nature  of  most  interactions  between  the  acquisi¬ 
tion  and  user  communities? 

0  Are  these  interactions  generally  focused  on  reducing  or 
adding  requirements? 

0  Have  options  that  involve  trade-offs  among  cost,  schedule, 
and  performance  been  effectively  estimated  and  communi¬ 
cated  to  users? 

-  What  types  of  interactions  take  place  when  a  requirement  is 
found  to  be  more  difficult  to  meet  than  originally  expected? 
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0  If  a  requirement  is  found  to  be  infeasible,  how  often  is  it 
changed? 

0  How  long  does  it  take  to  communicate  and  make  the  change? 
0  What  are  the  roadblocks  to  making  changes  quickly? 

0  How  have  requests  for  significant  changes  by  the  acquisition 
community  been  received  by  users? 

—  Are  there  lessons  to  be  learned  from  programs  in  which  there 
was  a  healthy  relationship  between  the  user  and  acquisition 
communities? 

0  Were  there  specific  program  management  strategies  or  tech¬ 
niques  that  encouraged  this  relationship? 

0  How  can  positive  interactions  between  these  two  communi¬ 
ties  be  incentivized? 

Closing 

While  the  literature  on  cost  growth  over  the  past  60  years  is  compara¬ 
tively  rich  in  data,  analysis,  and  recommendations,  the  literature  on 
schedule  growth  is  relatively  limited.  Few  studies  have  looked  solely  at 
cycle  time  and  schedule  growth,  comparing  similar  data  on  multiple 
programs.  Even  fewer  reflect  current  policies  and  conditions.  Sched¬ 
ule  growth  tends  to  be  discussed  in  relation  to  cost  growth  for  various 
programs  over  time.  There  are  multiple  research  questions  that  can  be 
pursued,  but  a  broader  study  of  a  wide  range  of  major  defense  acquisi¬ 
tion  programs,  similar  to  Drezner  and  Smith’s  1990  review  of  weapon 
system  acquisition  schedules,  would  provide  a  better  understanding  of 
how  cycle  times  and  schedule  growth  have  changed  over  time.  The 
acquisition  system  would  also  benefit  from  comparisons  across  a  large 
set  of  MDAPs  for  which  data  on  schedules  for  key  points  after  Mile¬ 
stone  B  (or  its  equivalent)  have  been  available  in  Selected  Acquisition 
Reports  for  decades.  In  addition,  a  study  of  how  DoD  should  best 
manage  very  high  technology  risk  programs  that  ended  up  being  game 
changers  would  be  beneficial,  given  that  technical  risk  is  a  main  factor 
cited  in  the  literature  for  schedule  growth. 

The  literature  documenting  potential  ways  to  improve  program 
schedule  performance  is  also  relatively  thin.  Suggestions  are  typically 
mixed,  with  analyses  examining  other  acquisition  problems,  making  it 
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hard  to  isolate  schedule-related  factors  from  other  factors.  An  in-depth 
analysis  focusing  specifically  on  how  to  improve  schedules  in  acquisi¬ 
tion  programs  is  needed.  In  addition  to  cross-program  analyses,  the 
field  could  also  benefit  from  additional  detailed  case  studies  of  indi¬ 
vidual  programs  that  have  successfully  stayed  on  schedule,  in  addition 
to  the  ones  that  have  not.  This  type  of  study  would  help  analysts  iden¬ 
tify  how  concepts,  such  as  framing  assumptions,1  may  drive  schedule 
performance  (Arena  et  ah,  2013). 

In  closing,  it  is  important  to  keep  in  mind  that  cost,  schedule,  and 
performance  priorities  should  be  balanced  and  set  carefully  based  on 
each  individual  program’s  characteristics  and,  ultimately,  the  military 
needs  that  they  are  intended  to  satisfy.  Given  the  challenges  associated 
with  accelerating  programs  (e.g.,  securing  adequate  funds  and  develop¬ 
ing  technology),  the  benefits  of  an  aggressive  program  schedule  with¬ 
out  commensurate  adjustments  elsewhere  are  unclear.  Even  when  there 
is  an  urgent  operational  need  or  adversaries  have  a  critical  technologi¬ 
cal  edge,  reason,  discipline,  and  risk  management  must  prevail.  DoD’s 
efforts  to  improve  internal  processes  may  help  streamline  the  acquisi¬ 
tion  process  and  optimize  schedule  performance.  However,  prioritiza¬ 
tion  among  cost,  schedule,  and  performance  in  individual  programs 
must  be  logically  determined  and  made  clear  before  schedules  can  be 
set.  This  prioritization  and  its  implications  should  be  determined  and 
thoroughly  discussed  by  the  acquisition  and  user  communities  to  help 
avoid  future  problems  in  acquiring  warfighter  capabilities. 


1  “A  framing  assumption  is  any  explicit  or  implicit  assumption  that  is  central  in  shaping 
cost,  schedule,  and/or  performance  expectations”  (Arena  et  al.,  2013,  p.  xix). 


APPENDIX 


A  Case  Study  in  Fulfilling  an  Urgent  Operational 
Need:  The  MRAP  Acquisition  Program 


This  appendix  presents  a  case  study  of  a  unique  acquisition  program 
that  had  extraordinary  military,  White  House,  congressional,  and 
public  support  and  financial  resources  to  fulfill  a  critical  wartime  need 
on  a  very  ambitious  schedule.  The  Mine-Resistant  Ambush-Protected 
Vehicle  (MRAP)  program  is  widely  held  as  an  exemplary  “rapid  acqui¬ 
sition”  program  in  that  it  successfully  fulfilled  a  specific  UON  for 
improved  protection  from  improvised  explosive  devices  (IEDs)  for  the 
U.S.  Marine  Corps  and  Army  on  an  unusually  short  timeline.  While 
the  program  is  heralded  as  a  rapid- acquisition  success  story,  there  were 
a  number  of  unique  conditions  that  may  not  be  easily  replicated.  Exam¬ 
ples  of  these  conditions  include  an  existing  commercial  variant;  rela¬ 
tively  low  technical,  design,  and  integration  risk;  significant  internal 
and  external  senior  leadership  support;  and  a  nearly  unlimited  budget. 
However,  there  are  useful  lessons  that  can  be  learned  from  the  MRAP 
experience  that  can  be  applied  to  other  programs.  These  transferrable 
lessons  include 

•  using  proven  or  mature  technologies 

•  keeping  most  requirements  reasonably  stable 

•  prioritizing  schedule  over  cost 

•  compromising  on  some  technical  performance  requirements. 

Early  in  the  conflicts  in  Afghanistan  and  Iraq,  hundreds  of  U.S. 
service  members  were  killed  or  injured  by  IEDs  each  year.  U.S.  casual¬ 
ties  rose  to  more  than  1,000  per  year  by  2009.  A  need  for  better  pro- 
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tection  from  IEDs  was  badly  needed  because  the  vehicles  used  in  these 
regions  at  that  time  were  not  designed  to  sustain  blasts  from  below 
and,  thus,  provided  inadequate  protection.  Interest  in  providing  sol¬ 
diers  with  armored  vehicles  specifically  designed  to  protect  against  this 
threat  spread  from  the  war  zone  back  to  the  highest  levels  of  leadership 
in  the  Pentagon  and  Congress.  This  high-level  attention  and  support 
provided  a  platform  for  the  MRAP  program  to  move  quickly  in  pro¬ 
ducing  a  more  adequate  mechanism  for  dealing  with  IED  threats.  In 
response  to  a  validated  U.S.  Central  Command  JUON  statement,  the 
MRAP  program  office  was  created  on  November  1,  2006  (Howitz, 
2008).  In  May  2007,  former  Defense  Secretary  Robert  Gates  estab¬ 
lished  an  MRAP  task  force  with  the  mission  to  provide  “as  many  of 
those  vehicles  to  our  Soldiers  and  Marines  in  the  field  as  is  possible  in 
the  next  several  months”  (Howitz,  2008).  The  program  was  delivering 
a  significant  number  of  MRAPs  by  May  2008,  less  than  two  years  after 
the  program’s  official  inception  (GAO,  2009). 

Several  conditions  enabled  the  quick  production  and  fielding  of 
MRAP  vehicles: 

•  The  program  was  designated  as  “DoD’s  highest  priority  acquisi¬ 
tion”  and  was  provided  a  DX  rating  by  the  Secretary  of  Defense 
in  2007  (GAO,  2009). 1  This  special  status  afforded  the  program 
special  contracting  privileges,  which  helped  it  adhere  to  its  ambi¬ 
tious  schedule  and  motivated  greater  collaboration  and  coopera¬ 
tion  among  the  acquisition,  test,  and  user  communities. 

•  Program  officials  developed  a  creative  acquisition  and  contracting 
strategy,  and  they  managed  the  program  well. 

•  The  capability  gap  that  the  MRAPs  were  meant  to  fulfill  required 
minimal  technology  development,  allowing  the  program  to  move 
swiftly  to  the  production  phase  with  multiple  responsive  and 
capable  vendors  (Howitz,  2008). 

•  Perhaps  most  importantly,  the  schedule  was  designated  as  the 
top  priority  for  the  program  from  the  outset,  which  drove  deci- 


1  DX  is  the  code  for  the  highest-priority  defense  programs  in  the  Defense  Priorities  and 
Allocations  System. 
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sionmaking  and  management  behavior.  This  behavior  may  have 
differed  under  alternative  (e.g.,  cost  or  reliability)  considerations 
(Miller,  2010;  Sullivan,  2009;  Blakeman,  Gibbs,  and  Jeyasingam, 
2008). 


Requirements:  Defining  and  Maintaining  Program  Scope 

The  MRAP  program  was  motivated  by  a  specific,  high-priority  need  in 
the  U.S.  Marine  Corps  in  2005,  and,  by  2006,  it  had  been  designated  a 
JUON  by  U.S.  Central  Command.  Such  needs  are  defined  in  a  JUON 
statement,  which  aims  to  provide  validation  and  resourcing  for  a  solu¬ 
tion  in  an  extremely  short  time  period — usually  within  days  or  weeks 
(CJCSI  3170.01H,  2012).  The  specificity  and  high-priority  status  of 
the  MRAP  requirement  ensured  that  the  program  was  well  protected 
throughout  the  procurement  process. 

The  specific  requirement  that  the  MRAP  program  had  to  fulfill 
was  for  a  vehicle  that  could  better  protect  marines  from  IED  blasts.  The 
need  for  improved  protection  was  met  by  increasing  clearance  above 
the  ground,  adding  more  armor,  and  designing  a  V-shaped  hull  that 
would  be  better  able  to  deflect  such  blasts.  These  features  would  provide 
better  protection  than  those  offered  by  the  high-mobility  multipurpose 
wheeled  vehicles  that  the  Marine  Corps  was  using  at  the  time  (Howitz, 
2008).  These  specific  design  approaches  did  not  require  much  technol¬ 
ogy  development;  in  fact,  similar  vehicles  had  already  been  in  use  since 
the  1970s  in  South  Africa  and  Rhodesia  (now  Zimbabwe;  see  Hodge, 
2007).  In  addition,  as  discussed  later,  numerous  eligible  vendors  were 
capable  of  producing  the  vehicles.  The  decisions  to  keep  requirements 
to  a  minimum  and  to  use  proven  technologies  are  widely  credited  with 
the  program’s  ability  to  rapidly  meet  the  needs  of  the  Marine  Corps  and 
other  services.2  This  strategy  was  successful  despite  instability  in  quan¬ 
tity  orders  and  status.  Over  the  course  of  three  years,  what  began  as  a 


2  The  Marine  Corps  originally  planned  to  procure  just  1,169  vehicles,  but  in  2007  the 
program  became  a  joint  program — serving  all  three  services  and  U.S.  Special  Operations 
Command,  with  a  joint  requirement  for  over  16,000  vehicles.  See  Sullivan,  2009. 
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single-service,  ACAT  III  program  eventually  became  a  joint,  ACAT  ID 
program  (Blakeman,  Gibbs,  and  Jeyasingam,  2008). 

The  MRAP’s  requirements  remained  relatively  stable  throughout 
the  life  of  the  program  because  of  the  fact  that  requirements  changes 
could  not  be  made  without  senior-level  approval.  Although  there  may 
have  been  good  ideas  that  could  have  been  incorporated  later  on,  the 
MRAP  program  was  able  to  avoid  such  “requirements  creep”  and  keep 
the  program  moving  forward  (Miller,  2010). 


Resource  Allocation  and  Management 

The  higher  priority  a  program  has,  the  more  likely  it  is  to  secure  and 
keep  the  funding  necessary  to  maintain  its  schedule.  Because  of  its 
high-priority  status,  the  MRAP  program  did  not  face  many  obstacles 
in  terms  of  securing  or  defending  funding  and  resources.  Congressio¬ 
nal  support  and  a  DX  rating  afforded  the  program  nearly  unlimited 
funding,  including  about  $22.7  billion  for  procurement.  These  funds 
were  provided  primarily  through  supplemental  appropriations  and,  at 
times,  emergency  appropriations  and  reprogramming  actions  (Miller, 
2010).  The  MRAP  program  was  essentially  immune  to  the  externally 
driven  funding  cuts  or  delays  that  other  defense  acquisition  programs 
often  face. 


Tailoring  the  Acquisition  Process  and  Setting  Priorities 

To  meet  its  aggressive  timeline,  the  MRAP  program  pursued  a  tai¬ 
lored  acquisition  plan,  including  approval  to  perform  “simultaneous 
execution  of  all  facets  of  the  DoD  acquisition  framework”  (Blakeman, 
Gibbs,  and  Jeyasingam,  2008).  While  the  program  was  still  required  to 
provide  all  required  acquisition  documentation,  many  of  the  required 
documents  were  provided  after  the  decisions  they  were  supposed  to 
support.  The  program  did  not  have  an  APB  prior  to  starting  procure¬ 
ment  at  Milestone  C  in  February  2007.  The  APB  was  not  approved 
until  June  16,  2008.  Typically,  an  APB  is  required  before  procure- 
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ment  can  begin.  According  to  the  program’s  December  2009  Selected 
Acquisition  Report,  the  full-rate  production  (FRP)  milestone  was  not 
required  for  the  MRAP  program  “because  the  total  program  objective 
is  being  achieved  via  a  series  of  Low  Rate  Initial  Production  (LRIP) 
orders  reviewed  and  approved  individually  by  the  [Milestone  Decision 
Authority].  The  Joint  MRAP  has  already  acquired  22,880  of  the  26,882 
(Acquisition  Objective)  vehicle  requirement  negating  the  requirement 
for  an  FRP  decision”  (DoD,  2009).  The  capability  production  docu¬ 
ment  (CPD)  also  lagged  the  decisions  it  was  supposed  to  support.  The 
CPD  provides  the  operational  requirements  of  the  production  system, 
including  key  performance  parameters  (DoDI  5000.02,  2008).  MRAP 
production  contracts  were  awarded  and  testing  was  under  way  before 
the  CPD  was  approved  by  the  Joint  Requirements  Oversight  Council. 

All  this  is  not  to  say  that  there  was  insufficient  oversight  of 
the  MRAP  program.  On  the  contrary,  extensive  decision  meetings, 
reviews,  and  ad  hoc  oversight  were  conducted  outside  the  regular  pro¬ 
cess  calendars.  These  examples,  however,  show  how  formal  reports  and 
processes  can  be  delayed  or  adjusted  based  on  operational  need. 


Concurrency 

For  the  MRAP  program,  the  use  of  proven  technologies  facilitated  a 
high  level  of  concurrency.  Blakeman,  Gibbs,  and  Jeyasingam  (2008, 
p.  30)  noted  that  “the  MRAP  program  simultaneously  conducted 
developmental  testing,  operational  testing,  production,  integration, 
fielding,  and  disposal,  while  also  refining  requirements  to  account  for 
an  increasing  Explosively  Formed  Penetrator  (EFP)  threat  and  greater 
need  in  the  restrictive  terrain  of  Afghanistan.” 


Contract  Structures  and  Competition 

Many  contracting  activities  that  normally  occur  in  sequence  were  con¬ 
ducted  in  parallel  to  expedite  the  contracting  process  for  the  MRAP 
program.  To  begin  production,  a  sole-source  contract  was  awarded  to 
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a  company  with  an  active  production  line,  while  a  request  for  proposal 
was  released  to  industry.  The  joint  program  office  received  bids  from 
ten  companies.  Because  of  the  unusually  high  number  of  capable  man¬ 
ufacturers,  nine  IDIQ  contracts3  were  awarded  for  test  vehicles.  While 
the  source  selection  criteria  focused  heavily  on  survivability,  significant 
schedule  incentives  were  specified.  An  incentive  award  of  $100,000  was 
provided  for  each  test  vehicle  delivered  early  (Blakeman,  Gibbs,  and 
Jeyasingam,  2008,  citing  an  internal  program  document).  Five  compa¬ 
nies  were  awarded  large  LRIP  contracts  prior  to  testing.  A  contracting 
mechanism  established  costs  and  prices  with  vendors  up  front,  allow¬ 
ing  quick  remediation  of  contract  modifications  and  helping  to  expe¬ 
dite  schedules  and  minimize  costs  by  avoiding  lengthy  negotiations. 
Without  such  an  approach,  every  engineering  change  proposal  would 
have  required  negotiation. 

One  of  the  biggest  challenges  to  rapid  procurement  was  quickly 
finding  available  government  contracting  officers  who  were  skilled 
in  executing  such  large,  complex  contracts.  Also  key  was  getting  the 
Defense  Contract  Management  Agency  to  work  closely  with  all  stake¬ 
holders  to  ensure  delivery  of  the  vehicles  on  the  streamlined  sched¬ 
ule.  Conditional  acceptance  of  vehicles  with  minor  issues  was  allowed, 
which  also  sped  delivery.  Finally,  a  good  relationship  between  vendors 
and  the  Space  and  Naval  Warfare  Systems  Command  helped  the  gov¬ 
ernment  with  integration;  this  was  important  because  the  government 
maintained  responsibility  for  integrating  mission  equipment  with  the 
vehicles. 


Conclusion 

In  summary,  the  MRAP  program’s  exceptional  stakeholder  support 
and  resulting  process  flexibility  are  difficult  to  replicate — at  least  in 
a  program  that  does  not  fulfill  such  an  urgent  need.  Furthermore, 
the  program  did  not  suffer  from  technical  risk,  and  key  requirements 


3  See  the  Federal  Acquisition  Regulation,  undated.  Subpart  16.5,  for  information  on  indef¬ 
inite-delivery  contracts. 
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were  not  challenged.  However,  the  MRAP  program  demonstrated 
that  a  creative  acquisition  strategy  supported  by  adequate  resourcing, 
cooperation  between  the  acquisition  and  user  communities,  and  effec¬ 
tive  program  management  can  greatly  expedite  acquisition. 
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his  report  summarizes  a  selection  of  the  defense  acquisition 
literature  from  the  1960s  to  the  present  on  potential  sources 
of  prolonged  acquisition  cycle  times  and  schedule  growth,  as 
well  as  potential  opportunities  for  improvement.  It  presents 
the  range  of  possible  causes  of  schedule-related  problems  and  various 
recommendations  cited  for  improving  schedules  by  various  authors 
and  organizations.  This  report  does  not  provide  critical  analysis  or 
an  assessment  of  the  strengths  or  weaknesses  of  the  claims  made  in 
the  literature.  Rather,  it  provides  a  starting  point  for  further  research 
or  consideration  by  government  acquisition  professionals,  oversight 
organizations,  and  the  analytic  community.  We  identified  the  following 
reasons  for  schedule  delays  in  the  literature:  (1)  the  difficulty  of  managing 
technical  risk  (e.g.,  program  complexity,  immature  technology,  and 
unanticipated  technical  issues),  (2)  initial  assumptions  or  expectations 
that  were  difficult  to  fulfill  (e.g.,  schedule  estimates,  risk  control, 
requirements,  and  performance  assumptions),  and  (3)  funding  instability. 
The  most  commonly  cited  recommendations  for  reducing  cycle  time  and 
controlling  schedule  growth  in  the  literature  are  strategies  that  manage 
or  reduce  technical  risk.  Some  of  those  recommendations  include  using 
incremental  fielding  or  evolutionary  acquisition  strategies,  developing 
derivative  products  (rather  than  brand-new  designs),  using  mature 
or  proven  technology  (i.e.,  commercial,  off-the-shelf  components), 
maintaining  stable  funding,  and  using  atypical  contracting  vehicles. 
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